Skip to content

reduce samurai memory usage - #1924

Merged
kyakuno merged 1 commit into
masterfrom
add_mem_mode_to_samurai
Aug 27, 2026
Merged

reduce samurai memory usage#1924
kyakuno merged 1 commit into
masterfrom
add_mem_mode_to_samurai

Conversation

@ohshima-axell

Copy link
Copy Markdown
Contributor

object_tracking/samurai のメモリ使用量が大きかったため #1918 を参考に、memory_mode の指定を追加しました。メモリ使用量の変化はおおよそ以下の通りです(CPU は htop、CUDA は nvidia-smi の表示を読んだもの)。

  • CPU: 12.5GB → 4GB
  • fp32 CUDA: 12.2GB → 4GB
  • fp16 CUDA: 6.9GB → 2.5GB

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

object_tracking/samurai の推論実行時メモリ使用量を抑えるため、ailia backend 利用時に memory_mode を明示指定してネット初期化する変更です(#1918 の対応パターンに近い形)。

Changes:

  • ailia.get_memory_mode(...)mem_mode を作成し、4つの ailia.Net 初期化(backbone / sam_heads / memory_encoder / memory_attn)に memory_mode を付与
  • ONNX Runtime 経路(args.onnx)は挙動変更なし

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@kyakuno
kyakuno merged commit 99b8a41 into master Aug 27, 2026
1 check passed
@kyakuno
kyakuno deleted the add_mem_mode_to_samurai branch August 27, 2026 03:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants