Search results

qwen3: concurrent prompts serialize on the per-step prefill budget

qwen3Qwen3-4B model crate (pegainfer-qwen3-4b)Qwen3-4B model crate (pegainfer-qwen3-4b)

Status: Open.

#744 In openinfer-project/openinfer;

· FeathBow opened on Jul 22, 2026

Qwen3: first content token deferred to first decode step adds ~one decode step to TTFT

Status: Open.

#738 In openinfer-project/openinfer;

· xiaguan opened on Jul 22, 2026

Frontend-buffered validation and repair for invalid tool calls

Status: Open.

#733 In openinfer-project/openinfer;

· xiaguan opened on Jul 20, 2026

qwen35: add adaptive decode-priority scheduling for mixed prefill/decode load

Status: Open.

#727 In openinfer-project/openinfer;

· CAICAIIs opened on Jul 19, 2026

Support out-of-process PegaFlow

Status: Open.

#724 In openinfer-project/openinfer;

· xiaguan opened on Jul 19, 2026

frontend: preserve logprobs request semantics and return prompt logprobs instead of HTTP 500

Status: Open.

#720 In openinfer-project/openinfer;

· FeathBow opened on Jul 18, 2026

RFC: adaptive per-request verify windows under load (SPS(B) scheduler, DSpark Phase 3) — design space + CUDA-graph strategy

Status: Open.

#718 In openinfer-project/openinfer;

· n-WN opened on Jul 18, 2026

qwen3/dspark: confidence-head verify-window truncation (DSpark Phase 2)

qwen3Qwen3-4B model crate (pegainfer-qwen3-4b)Qwen3-4B model crate (pegainfer-qwen3-4b)

Status: Open.

#717 In openinfer-project/openinfer;

· n-WN opened on Jul 18, 2026

perf(kimi-k2): compact local top-1 readback into one pinned transfer

kimi-k2Kimi-K2 model crate (pegainfer-kimi-k2)Kimi-K2 model crate (pegainfer-kimi-k2)

Status: Open.

#716 In openinfer-project/openinfer;

· FeathBow opened on Jul 18, 2026

qwen35: reduce active-decode stalls from serial Unified prefill

enhancementNew feature or requestNew feature or request

hw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verify

qwen35Qwen3.5-4B model crate (pegainfer-qwen35-4b)Qwen3.5-4B model crate (pegainfer-qwen35-4b)

Status: Open.

#715 In openinfer-project/openinfer;

· CAICAIIs opened on Jul 18, 2026

perf(qwen): reuse PrefillPagedPlan for uncompiled-GQA decode

qwen3Qwen3-4B model crate (pegainfer-qwen3-4b)Qwen3-4B model crate (pegainfer-qwen3-4b)

qwen35Qwen3.5-4B model crate (pegainfer-qwen35-4b)Qwen3.5-4B model crate (pegainfer-qwen35-4b)

Status: Open.

#711 In openinfer-project/openinfer;

· FeathBow opened on Jul 18, 2026

qwen3: scheduler can park on blocking_recv while an async decode-overlap prefill is still in flight

qwen3Qwen3-4B model crate (pegainfer-qwen3-4b)Qwen3-4B model crate (pegainfer-qwen3-4b)

Status: Open.

#699 In openinfer-project/openinfer;

· FeathBow opened on Jul 17, 2026