Skip to content

[codex] Add manual scheduler candidate index#6

Merged
AzurCrystal merged 1 commit into
developfrom
codex/fixperf
Jun 9, 2026
Merged

[codex] Add manual scheduler candidate index#6
AzurCrystal merged 1 commit into
developfrom
codex/fixperf

Conversation

@AzurCrystal

Copy link
Copy Markdown
Collaborator

Summary

  • add manual scheduler candidate indexes for selected large buckets
  • read only a bounded candidate set before falling back to the full scheduler snapshot
  • add config wiring and tests for indexed bucket behavior and fallback safety

Why

Large OpenAI account pools were forcing hot request paths to materialize and JSON-decode full Redis scheduler snapshots. This adds an opt-in path so specific buckets can be sampled through a Redis candidate index instead of reading the entire pool on every load-balance selection.

Validation

  • go test ./backend/internal/service ./backend/internal/repository

@AzurCrystal AzurCrystal marked this pull request as ready for review June 9, 2026 07:44
@AzurCrystal AzurCrystal merged commit 5ebf81f into develop Jun 9, 2026
10 of 12 checks passed
@AzurCrystal AzurCrystal deleted the codex/fixperf branch June 9, 2026 07:47
@github-actions github-actions Bot locked and limited conversation to collaborators Jun 9, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant