Skip to content

fix: middleware initialization error - #19

Merged
Cyberlink404 merged 2 commits into
masterfrom
fix-job-table
Jul 13, 2025
Merged

fix: middleware initialization error#19
Cyberlink404 merged 2 commits into
masterfrom
fix-job-table

Conversation

@Cyberlink404

@Cyberlink404 Cyberlink404 commented Jul 13, 2025

Copy link
Copy Markdown
Contributor

关联 Issue

主要改动

  1. 调整打包配置
  2. 升级依赖
  3. middleware初始化时不再初始化queue数据库

界面截图

测试计划 (暂无)

检查清单

  • 本次变更的兼容性测试覆盖了 Chrome

Summary by AIGNE

发布说明

重构

  • 重构爬虫核心组件,优化队列管理和初始化流程
  • 改进中间件缓存管理系统,提升性能和可靠性
  • 简化应用启动流程,移除冗余的数据库迁移步骤

技术优化

  • 更新TypeScript配置以支持现代模块系统
  • 优化依赖导入机制,提升代码加载效率
  • 统一队列初始化逻辑,增强系统稳定性

影响

这些更改主要针对系统内部架构优化,提升了系统整体性能和可维护性。最终用户不会感知到直接的功能变化,但系统运行将更加稳定和高效。

@github-actions

github-actions Bot commented Jul 13, 2025

Copy link
Copy Markdown

Image description AIGNE Framework

Walkthrough

此次变更主要围绕三个核心方面:1) 重构爬虫核心功能,引入显式队列初始化和统一的初始化流程;2) 优化中间件架构,改进缓存管理和依赖导入;3) 更新TypeScript配置以支持现代模块系统。这些改进提升了代码的可维护性和模块化程度,同时确保了更好的类型支持和构建优化。

Changes

文件组 变更摘要
爬虫核心文件
- crawler.ts
- index.ts
- site.ts
- puppeteer.ts
重构队列管理系统,统一初始化流程。引入cronQueue变量,优化爬虫初始化逻辑。调整浏览器下载功能和模块导入方式。
中间件相关
- middleware/cache.ts
- middleware/index.ts
- snap-kit/hooks/pre-start.ts
优化CacheManager初始化流程,改进依赖导入方式,简化启动流程并移除冗余的数据库迁移功能。
TypeScript配置
- 各模块的tsconfig文件
- 根目录tsconfig.json
统一更新至node16模块系统,优化模块解析策略,调整构建配置以支持现代化模块开发。

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description AIGNE Framework

Commits Files that changed from the base of the PR and between cd31d55 and 27ba7f5 commits.
Files selected (12)
  • blocklets/snap-kit/api/src/hooks/pre-start.ts (2)
  • packages/crawler/src/crawler.ts (2)
  • packages/crawler/src/index.ts (2)
  • packages/crawler/src/puppeteer.ts (1)
  • packages/crawler/src/site.ts (3)
  • packages/crawler/tsconfig.cjs.json (1)
  • packages/crawler/tsconfig.esm.json (1)
  • packages/middleware/src/cache.ts (3)
  • packages/middleware/src/index.ts (1)
  • packages/middleware/tsconfig.cjs.json (1)
  • packages/middleware/tsconfig.esm.json (1)
  • tsconfig.json (1)
Files ignored due to filter (7)
  • CHANGELOG.md
  • blocklets/snap-kit/blocklet.yml
  • blocklets/snap-kit/package.json
  • package.json
  • packages/crawler/package.json
  • packages/middleware/package.json
  • pnpm-lock.yaml
Files skipped from review due to trivial changes (1)
  • packages/middleware/src/index.ts
Review comments generated (19)
  • Review: 13
  • LGTM: 6

提示

Image description AIGNE Reviewer (@aignebot) 聊天

  • 回复此机器人留下的审查评论以提出后续问题。审查评论是对差异或文件的评论。
  • 通过在回复中标记 @aignebot 邀请机器人加入审查评论链。

代码建议

  • 机器人可能会提出代码建议,但在提交前请仔细审查它们,因为行号范围可能会不对齐。
  • 你可以编辑机器人做出的评论,并在建议稍有偏差时手动调整。

暂停增量审查

  • 在 PR 描述中的任何位置添加 @aignebot: ignore 以暂停机器人的进一步审查。

Comment thread blocklets/snap-kit/api/src/hooks/pre-start.ts
Comment thread packages/crawler/src/site.ts
Comment thread packages/crawler/src/site.ts
Comment thread packages/crawler/src/site.ts
Comment thread packages/crawler/src/index.ts
Comment thread packages/crawler/tsconfig.esm.json
Comment thread packages/middleware/src/cache.ts
Comment thread packages/middleware/src/cache.ts
Comment on lines +7 to +8
"moduleResolution": "bundler",
"outDir": "lib/esm"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description AIGNE Framework

建议调整moduleResolution配置,使用Node.js更稳定的解析策略:

-    "moduleResolution": "bundler",
-    "outDir": "lib/esm"
+    "moduleResolution": "node16",
+    "outDir": "lib/esm"

原因:

  • bundler 解析策略相对较新,在某些工具链中可能存在兼容性问题
  • node16 解析策略是 Node.js 官方推荐的 ESM 解析方案
  • 使用 node16 可以获得更好的 IDE 支持和类型推导
  • 对于中间件这种服务端包,node16 解析策略更合适

Comment thread tsconfig.json
@Cyberlink404 Cyberlink404 changed the title fix: middleware initialization error @Cyberlink404 fix: middleware initialization error Jul 13, 2025
@Cyberlink404
Cyberlink404 merged commit 7276786 into master Jul 13, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant