Skip to content

fix: support encrypted Qwen vision models and RK picture frames - #154

Merged
athenawxd merged 3 commits into
mainfrom
codex/qwen-vision-guard
Sep 8, 2026
Merged

fix: support encrypted Qwen vision models and RK picture frames#154
athenawxd merged 3 commits into
mainfrom
codex/qwen-vision-guard

Conversation

@athenawxd

@athenawxd athenawxd commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Qwen RKLLM image analysis now loads a CEMC-encrypted vision.rknn through Model Guard using the installed device certificate. Plain RKNN files retain their native loading path, protected-model failures never fall back to native loading, and the adjacent model.rkllm continues to use the vendor loader.

The picture worker also accepts host-backed CPU/Rockchip frames after EnsureHostData succeeds. Previously it additionally required GetHostData, rejecting valid frames whose pixels are exposed through GetData with InvalidParam/13 before inference. Failed host transfers remain rejected.

Validation:

  • Reproduced the original failure through authenticated image upload and picture analysis.
  • Real picture-worker regression: old code fails; fixed code passes 25 assertions, including failed-transfer and inactive-frame rejection.
  • CPU build and full suite: 1,013 test cases, 17,217 assertions passed.
  • RK3576 production-release engine with RKLLM and Model Guard built successfully.
  • Changed files pass clang-format 18. Full-tree formatting still reports 25 pre-existing files, including dependencies under node_modules.
  • Encrypted model initialization was observed on RK hardware. End-to-end inference with the updated picture-worker binary has not yet been verified on the device.

Signed-off-by: wangxudong <athena_wxd@163.com>
Honor EnsureHostData for CPU and Rockchip frames instead of requiring a separate host copy. Preserve failed-transfer rejection and cover the real picture worker with regression tests.

Signed-off-by: wangxudong <athena_wxd@163.com>
@athenawxd athenawxd changed the title fix(infer): load encrypted Qwen vision models through Guard fix: support encrypted Qwen vision models and RK picture frames Sep 8, 2026
@athenawxd
athenawxd merged commit c2ee660 into main Sep 8, 2026
8 checks passed
@athenawxd
athenawxd deleted the codex/qwen-vision-guard branch September 8, 2026 04:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant