Skip to content

nixl: Add fp8 KV cache scale transfer in P/D disaggregated inference#4

Draft
zhenwei-intel with Copilot wants to merge 3 commits into
mainfrom
copilot/support-fp8-kv-cache
Draft

nixl: Add fp8 KV cache scale transfer in P/D disaggregated inference#4
zhenwei-intel with Copilot wants to merge 3 commits into
mainfrom
copilot/support-fp8-kv-cache

Address code review: fix spelling, add k/v scale length check, use to…

828acc3
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs