Skip to content

Add per-model KV quantization and physical request-capacity accounting - #860

Draft
Gajesh2007 wants to merge 5 commits into
masterfrom
feat/paged-kv-quantization
Draft

Add per-model KV quantization and physical request-capacity accounting#860
Gajesh2007 wants to merge 5 commits into
masterfrom
feat/paged-kv-quantization

Record published KV review and final local checks

d2e7a7f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar