-
-
Notifications
You must be signed in to change notification settings - Fork 25
Back to Milestones
M2: Sovereign enterprise (B200-ready)
OpenJul 13, 2026
Due by August 31, 2026
•Last updated The enterprise production gate: multi-cluster federation, B200 validation, air-gapped model sources, SLO declaration (Pyrra), GPUQuota, supply-chain provenance, and multi-vendor GPU scheduling.
56% complete
List view
0 of 21 selected 0 issues of 21 selected
Enterprise readiness: NVIDIA Blackwell B200 (sm_100) validation matrix and deltas
area/gpuGPU-related features and issuesGPU-related features and issuesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)status/needs-triageNeeds investigation and prioritizationNeeds investigation and prioritizationStatus: Open.#413 In defilantech/LLMKube;Air-gapped deployment: Support local/private model sources
area/securitySecurity-related issuesSecurity-related issuesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#53 In defilantech/LLMKube;feat(observability): per-InferenceService SLO declaration via Pyrra integration
area/observabilityMonitoring, metrics, logging, tracingMonitoring, metrics, logging, tracingcomponent/apiRelated to CRDs and API definitionsRelated to CRDs and API definitionsenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#415 In defilantech/LLMKube;feat(api): GPUQuota CRD + admission webhook + RBAC bundle for multi-tenant deployments
area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolationcomponent/apiRelated to CRDs and API definitionsRelated to CRDs and API definitionsenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#416 In defilantech/LLMKube;Add container image scanning and supply chain security
area/securitySecurity-related issuesSecurity-related issuesciCI/CD related changesCI/CD related changesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#233 In defilantech/LLMKube;feat: TurboQuant KV cache quantization support (3-bit keys / 2-bit values)
area/gpuGPU-related features and issuesGPU-related features and issuesarea/performancePerformance optimization and benchmarkingPerformance optimization and benchmarkingenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#308 In defilantech/LLMKube;[FEATURE] Epic: multi-cluster federation (datacenter + multi-site edge fleet)
area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatchcomponent/controllerRelated to the operator controllerRelated to the operator controllerenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#630 In defilantech/LLMKube;[FEATURE] First-class Envoy AI Gateway integration: make the gateway fleet-aware
area/networkingService mesh, ingress, networkingService mesh, ingress, networkingarea/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatchenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#661 In defilantech/LLMKube;[FEATURE] Epic: first-class AMD accelerator tier (Strix Halo / RDNA, Vulkan + ROCm)
area/gpuGPU-related features and issuesGPU-related features and issuesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#696 In defilantech/LLMKube;[FEATURE] Validated AMD (Vulkan) example InferenceService + benchmark
area/gpuGPU-related features and issuesGPU-related features and issuesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#699 In defilantech/LLMKube;[FEATURE] AMD GPU observability: rocm-smi exporter + llama.cpp /metrics + Grafana panel
area/gpuGPU-related features and issuesGPU-related features and issuesarea/observabilityMonitoring, metrics, logging, tracingMonitoring, metrics, logging, tracingenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#700 In defilantech/LLMKube;[FEATURE] ROCm 7.2 HIP runtime tier for AMD nodes (per-model opt-in, follow-on)
area/gpuGPU-related features and issuesGPU-related features and issuesarea/runtimeRuntime backend and inference engine supportRuntime backend and inference engine supportenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/lowLow priorityLow prioritysize/largeLarge effort (> 3 days)Large effort (> 3 days)Status: Open.#701 In defilantech/LLMKube;[BUG] hostpath PVC provisioning blocked on tainted GPU nodes (breaks AMD/Vulkan model staging)
area/gpuGPU-related features and issuesGPU-related features and issuesbugSomething isn't workingSomething isn't workingcomponent/controllerRelated to the operator controllerRelated to the operator controllerdocumentationImprovements or additions to documentationImprovements or additions to documentationpriority/mediumMedium priorityMedium prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#850 In defilantech/LLMKube;[FEATURE] Ship foreman-agent (and metal-agent) via the Homebrew tap for one-command edge upgrades
component/metal-agentRelated to the Metal agent for macOSRelated to the Metal agent for macOSenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/lowLow priorityLow prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#822 In defilantech/LLMKube;[FEATURE] GPUQuota status reconciler (#416 story 2)
area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolationcomponent/controllerRelated to the operator controllerRelated to the operator controllerenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#1093 In defilantech/LLMKube;[FEATURE] GPUQuota validating webhook wiring (#416 story 4)
area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolationcomponent/controllerRelated to the operator controllerRelated to the operator controllerenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#1095 In defilantech/LLMKube;[FEATURE] Helm multitenancy toggle + tenant RBAC (#416 story 5)
area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolationarea/securitySecurity-related issuesSecurity-related issuesciCI/CD related changesCI/CD related changesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#1096 In defilantech/LLMKube;[FEATURE] Multi-tenancy docs + Grafana panel (#416 story 6)
area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolationarea/observabilityMonitoring, metrics, logging, tracingMonitoring, metrics, logging, tracingenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/smallSmall effort (< 1 day)Small effort (< 1 day)Status: Open.#1097 In defilantech/LLMKube;[FEATURE] Air-gapped: s3:// model source support (#53)
area/securitySecurity-related issuesSecurity-related issuescomponent/controllerRelated to the operator controllerRelated to the operator controllerenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#1098 In defilantech/LLMKube;[FEATURE] Air-gapped: local file path model source (#53 Phase 1)
area/securitySecurity-related issuesSecurity-related issuescomponent/cliRelated to the CLI toolRelated to the CLI toolcomponent/controllerRelated to the operator controllerRelated to the operator controllerenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/highHigh priorityHigh prioritysize/mediumMedium effort (1-3 days)Medium effort (1-3 days)Status: Open.#1099 In defilantech/LLMKube;[FEATURE] Supply chain: add govulncheck to CI (#233)
area/securitySecurity-related issuesSecurity-related issuesciCI/CD related changesCI/CD related changesenhancementNew feature or requestNew feature or requestkind/featureNew feature or requestNew feature or requestpriority/mediumMedium priorityMedium prioritysize/smallSmall effort (< 1 day)Small effort (< 1 day)Status: Open.#1100 In defilantech/LLMKube;