Skip to content

fix(collector): align model dtype for vLLM FlashInfer fp8 KV attention#1382

Open
kaim-eng wants to merge 1 commit into
mainfrom
pr3/collector-vllm-flashinfer-fp8-kv-dtype
Open

fix(collector): align model dtype for vLLM FlashInfer fp8 KV attention#1382
kaim-eng wants to merge 1 commit into
mainfrom
pr3/collector-vllm-flashinfer-fp8-kv-dtype