Skip to content

[Python][RunInference] vLLM: prefix-aware batching and capacity-based autoscaling - #40908

Draft
AMOOOMA wants to merge 22 commits into
apache:masterfrom
AMOOOMA:pr-vllm-integration
Draft

AMOOOMA wants to merge 22 commits into
apache:masterfrom
AMOOOMA:pr-vllm-integration

[RunInference] vLLM: prefix-aware batching and capacity-based autosca…

5687806
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Nov 6, 2026 in 16s