Skip to content

[Python] Support max_batch_weight in BatchElements and honor element_size_fn in stateful batching - #40603

Closed
tvalentyn wants to merge 2 commits into
apache:masterfrom
tvalentyn:fix-runinference-keyed-batching
Closed

[Python] Support max_batch_weight in BatchElements and honor element_size_fn in stateful batching#40603
tvalentyn wants to merge 2 commits into
apache:masterfrom
tvalentyn:fix-runinference-keyed-batching

Commits

  1. Commits on Oct 15, 2026