Skip to content

fix(infra): widen MIG zone set (L4 capacity flaps) - #8

Merged
rryoung98 merged 1 commit into
mainfrom
feat/zones-wide
Aug 12, 2026
Merged

fix(infra): widen MIG zone set (L4 capacity flaps)#8
rryoung98 merged 1 commit into
mainfrom
feat/zones-wide

Conversation

@rryoung98

Copy link
Copy Markdown
Contributor

us-central1-c had capacity during probing but stocked out minutes later. With ANY target shape + 3 zones, the MIG retries wherever capacity appears.

Copilot AI lite review requested due to automatic review settings August 12, 2026 05:26

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Widens the zonal distribution for the model regional MIG to better tolerate zone-local L4 GPU capacity stockouts in us-central1.

Changes:

  • Expands model_zones default from a single zone to us-central1-a/b/c to allow capacity to be found across multiple zones.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread infra/variables.tf
Comment on lines 16 to 20
variable "model_zones" {
description = "Zones the model MIG may use; spread wide since L4 capacity varies by zone."
type = list(string)
default = ["us-central1-c"] # probed 2026-08-12: -a and -b stocked out for L4; MIG retries do not roam zones reliably
default = ["us-central1-a", "us-central1-b", "us-central1-c"] # L4 stockouts flap zone-to-zone; ANY shape lets MIG chase capacity
}
@rryoung98
rryoung98 merged commit 7ae4a0e into main Aug 12, 2026
2 checks passed
@rryoung98
rryoung98 deleted the feat/zones-wide branch August 12, 2026 05:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants