Repository navigation

FEAT: support SGLang Xavier KV sharing and native GPU PD - #5631

Merged

qinxuye merged 26 commits into

xorbitsai:mainfrom

qinxuye:feat/sglang-xavier-cache

Oct 6, 2026

Merged

FEAT: support SGLang Xavier KV sharing and native GPU PD#5631
qinxuye merged 26 commits into
xorbitsai:mainfrom
qinxuye:feat/sglang-xavier-cache

Commits on Oct 4, 2026
- FEAT: support SGLang Xavier KV sharing and PD handoff
  qinxuye
  committed
  1a27e63
- fix: type internal SGLang PD handoff metadata
  qinxuye
  committed
  fd44b33
- FEAT: use Xavier GPU transfer for SGLang PD
  qinxuye
  committed
  6113443
- FEAT: compare SGLang native NIXL through Xinference PD
  qinxuye
  committed
  ee89235
- FIX: preserve EOS control for controlled PD benchmarks
  qinxuye
  committed
  e8369c6
- FIX: narrow SGLang bootstrap model type explicitly
  qinxuye
  committed
  200753c
- PERF: validate SGLang GPU handoff once before streaming output
  qinxuye
  committed
  f170892
- CI: cover native SGLang PD and benchmark regressions
  qinxuye
  committed
  2b6e249
- FIX: reject unsupported SGLang decode radix caching at launch
  qinxuye
  committed
  9ea3e68
- PERF: reduce SGLang Xavier GPU handoff overhead
  qinxuye
  committed
  973fe0b
Commits on Oct 5, 2026
- PERF: isolate SGLang Xavier transfers with CUDA IPC
  qinxuye
  committed
  d818150
- FIX: prevent replaying SGLang CUDA IPC descriptors
  qinxuye
  committed
  4517544
- FIX: retain independent SGLang benchmark telemetry
  qinxuye
  committed
  17d16ad
- PERF: prevent SGLang PD initialization GC stalls
  qinxuye
  committed
  89525ce
- FIX: include initialized PD libraries in existing GC freeze
  qinxuye
  committed
  6e7245b
- TEST: initialize PD fields in mocked SGLang runtime
  qinxuye
  committed
  511bbf3
- PERF: reuse SGLang PD directory and namespace
  qinxuye
  committed
  339d22a
- PERF: cache SGLang PD prompt fingerprints
  qinxuye
  committed
  f26b5f6
- fix: stabilize CI dependencies and model size parsing
  qinxuye
  committed
  bd74dca
- test: synchronize tokenization event loop regression
  qinxuye
  committed
  ca5a567
- fix: constrain the complete CI Hugging Face dependency stack
  qinxuye
  committed
  1f5cb6d
Commits on Oct 6, 2026
- fix: address SGLang Xavier lifecycle review
  qinxuye
  committed
  e442c5d
- fix: authenticate SGLang Runtime startup metadata
  qinxuye
  committed
  eaf0086
- fix: tighten SGLang Xavier handoff cleanup
  qinxuye
  committed
  28f15b0
- merge: sync SGLang Xavier with main
  qinxuye
  committed
  878372e
- fix: address SGLang Xavier handoff lifecycle review
  qinxuye
  committed
  0910aaa

Commits

Commits on Oct 4, 2026

Commits on Oct 5, 2026

Commits on Oct 6, 2026