Repository navigation

[#40644][Python] Support max_batch_weight in BatchElements and honor element_size_fn in stateful and keyed RunInference batching - #40682

Merged

tvalentyn merged 3 commits into

apache:masterfrom

Eliaaazzz:fix/runinference-max-batch-weight

Oct 21, 2026

Merged

[#40644][Python] Support max_batch_weight in BatchElements and honor element_size_fn in stateful and keyed RunInference batching#40682
tvalentyn merged 3 commits into
apache:masterfrom
Eliaaazzz:fix/runinference-max-batch-weight

Commits on Oct 20, 2026
- [Python] Support max_batch_weight in BatchElements and honor element_size_fn in stateful batching
  
  tvalentyn
  authored and
  Eliaaazzz
  committed
  d37ad24
- Apply element_size_fn and batch_length_fn to examples in keyed RunInference handlers.
  
  tvalentyn
  authored and
  Eliaaazzz
  committed
  86d036c
- Finish max_batch_weight support for RunInference: issue number in CHANGES.md and pipeline-level regression tests
  Eliaaazzz
  committed
  a8d6afd