Skip to content

feat:maintainance for better startup speed - #21

Open
zpeng11 wants to merge 1 commit into
yuyuyzl:mainfrom
zpeng11:main
Open

feat:maintainance for better startup speed#21
zpeng11 wants to merge 1 commit into
yuyuyzl:mainfrom
zpeng11:main

Conversation

@zpeng11

@zpeng11 zpeng11 commented Mar 29, 2026

Copy link
Copy Markdown
Collaborator

Update:

  1. 更新了TRTEngine 对 Context 的持久化使用,让第二次以及之后使用TRT JIT几乎没有时间消耗
  2. 更完备的cuda graph catch,更高概率触发图重放加速
  3. 无用文件删除维护

TODO:

  1. 全部模型从NCHW 改 NHWC 导出,可能TRT有更优化的算子,且可以优化Int8 kernel性能
  2. FP8 CNN算子的Triton实现,需在ExecuTorch中调参

@zpeng11
zpeng11 requested a review from yuyuyzl March 29, 2026 20:58
@zpeng11

zpeng11 commented Mar 29, 2026

Copy link
Copy Markdown
Collaborator Author

@nick-haoran @yuyuyzl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant