Is it possible to set up flexible warm-up policies for Codex accounts with individual custom schedule? #14877
Replies: 4 comments 2 replies
|
I found this setting: Could somebody please chime in:
Thanks |
|
@MoralStrike You found the right setting. It's the only warm-up there is, and it isn't schedule-based. Answers from the code ( When it fires. Not on a timer you set. Once a minute it checks each opted-in Codex connection's session window, and it pings only when the window has rolled over while nobody was using it. It skips a connection that was pinged in the last 10 minutes, that is rate-limited, whose provider circuit is open, whose weekly quota is already used up, or that failed a ping in the last 15 minutes. On an idle account that works out to roughly one ping per 5-hour window. Kept on 24/7, it uses a little quota each time a window rolls idle, and nothing else. All accounts at once. They're checked in one pass, one after another, not in parallel. But accounts whose windows roll in the same minute do get pinged back to back, and there's no jitter between them. A custom per-account schedule doesn't exist. Size. The request is the prompt Fingerprint. It goes through the same Codex executor as your normal Codex traffic, so it's shaped and headed like any other Codex request from OmniRoute, not a bare API call. It does not replay your own coding prompt. Proxy: it does not respect it today. That's a bug, and your question is what surfaced it. The ping and the usage read that triggers it are sent without the connection's proxy context, so they leave through the global Until that's fixed, if the per-account proxy matters to you, leave the warm-up off for those accounts. Tracked in #14997, together with the option to spread pings out instead of bursting them. |
|
Thank you for your reply @diegosouzapw
Is it possible to introduce throttle delay to spread out the warm-up pings? A burst of request by multiple accounts at the same time (when, for example, you turn on your laptop and all accounts are cold) can cause token revocation.
Oh, I'm glad we caught it. That's sounds like a good way to nuke the tokens. :)
Is that considered normal looking traffic to OAI? Is that shaped as a Thanks |
|
@MoralStrike Taking these in order. Spreading the pings out. Not possible today. Adding a per-connection delay (jitter) so connections that go cold together don't all fire at once is already part of #14997, alongside the proxy fix. The two belong together: once the ping goes through each account's own proxy, spacing the pings out is the other half. Does it look like normal Codex traffic? Some of it I can answer from the code. The rest I can't. It goes through the same Codex executor as your real Codex requests, so its request shape and headers match OmniRoute's normal Codex traffic. It isn't an Finding the setting. The sidebar search only matches the names of sidebar items ( |


Uh oh!
There was an error while loading. Please reload this page.
Hi, Is it possible to set up flexible warm-up policies for Codex accounts with individual custom schedule?
The warm-up, if implemented, should respect proxy settings.
If something like that already exists, could you please point me -- I'm not seeing any warm-up settings for Codex.
Thank You!
All reactions