Skip to content

[Observability] Break down prefill #cached-token into device / host / storage tiers#26976

Open
hxieustc wants to merge 10 commits into
sgl-project:mainfrom
hxieustc:add-fine-grain-prefill-cached-token-info
Open

[Observability] Break down prefill #cached-token into device / host / storage tiers#26976
hxieustc wants to merge 10 commits into
sgl-project:mainfrom
hxieustc:add-fine-grain-prefill-cached-token-info

Commits

Commits on Jun 26, 2026