Skip to content

FEAT: report cache hit tokens across vLLM, SGLang and MLX - #5647

Merged
qinxuye merged 3 commits into
xorbitsai:mainfrom
qinxuye:feat/xavier-cached-token-usage
Oct 7, 2026
Merged

qinxuye merged 3 commits into
xorbitsai:mainfrom
qinxuye:feat/xavier-cached-token-usage