Skip to content

feat(connector): support tensor-parallel KV cache#91

Merged
GentleCold merged 4 commits into
masterfrom
feat/multi-tp
Jul 12, 2026
Merged

feat(connector): support tensor-parallel KV cache#91
GentleCold merged 4 commits into
masterfrom
feat/multi-tp

perf(tests): default benchmarks to 128-token blocks

8f0310a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
unit-tests
succeeded Jul 11, 2026 in 46s