Skip to content

Improvement: Make batch sizes configurable#838

Merged
snova-rodrigom merged 7 commits into
mainfrom
improvement/make_batch_sizes_configurable
Jul 7, 2026
Merged

Improvement: Make batch sizes configurable#838
snova-rodrigom merged 7 commits into
mainfrom
improvement/make_batch_sizes_configurable

Conversation

@snova-rodrigom

Copy link
Copy Markdown
Collaborator
  • Added implementation to make batch sizes configurable but pointing to power of 2 values by default
  • Fixed representative batch calculation when failed requests happened
  • Tested with ruff and mypy

@snova-rodrigom snova-rodrigom self-assigned this Jul 2, 2026
@snova-rodrigom snova-rodrigom added the improvement Improvement label Jul 2, 2026
@snova-rodrigom
snova-rodrigom merged commit 5583ba1 into main Jul 7, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants