Skip to content

Add GPU Operator DevOps Agent package (prototype, for review & testing) - #450

Open
chenopis wants to merge 3 commits into
mainfrom
add-gpu-operator-devops-agent
Open

Add GPU Operator DevOps Agent package (prototype, for review & testing)#450
chenopis wants to merge 3 commits into
mainfrom
add-gpu-operator-devops-agent

Conversation

@chenopis

Copy link
Copy Markdown
Collaborator

Summary

This PR adds a prototype GPU Operator DevOps Agent package under a new top-level gpu-operator-devops-agent/ directory — an AI-agent skill package (an AGENTS.md front door + operator skills + references) distilled from the public GPU Operator documentation in this repo and the public GPU Operator source. It lets an AI coding/ops agent (Claude, Cursor, etc.) help an operator install / operate / maintain / troubleshoot the GPU Operator with a probe-first, source-cited, safety-gated operating model — instead of a fresh agent guessing from an unstructured search.

Opened as a draft for review and hands-on testing — not for merge yet.

What's here

  • AGENTS.md — the agent operating charter: supported scope, source precedence, bootstrap/command-context policy, safety policy, skill routing, operating invariants, and stop/escalation conditions.
  • skills/ — six operator SOPs: gpu-operator-install, -operate, -maintain, -troubleshoot, -evidence-bundle, -improve.
  • references/ — the reasoning substrate: models.md (the layered NFD → driver → toolkit → device-plugin → validator → workload success ladder), branch-matrix.md (staged branch decisions), command-cards.md (validated recipes), field-scenario-cards.md + failure-signatures.md (troubleshooting), supported-scope.md, claim-ledger.md, and more.
  • scripts/ — a read-only environment inventory plus a few guarded mutation helpers.
  • runtime-memory/ — seed files the agent appends to as it learns.
  • README.md — how to test it, plus honesty caveats.

Placement

Placed at repo root as gpu-operator-devops-agent/ (outside every Sphinx docs_root), so the ./repo docs PR build ignores it entirely — no repo.toml change, no toctree warnings, zero docs-build interaction. If maintainers would rather co-locate it under gpu-operator/, that's a one-line sphinx_exclude_patterns addition — happy to move it.

How to test

See gpu-operator-devops-agent/README.md. In short: point an agent at gpu-operator-devops-agent/AGENTS.md as its front door, give it an operator task against a test-owned K3s + A100 sandbox (e.g. "install the GPU Operator on this node," "a GPU workload won't schedule after install," "upgrade and roll back if driver pods crash-loop"), and watch for: probe-first inventory before any mutation, cited doc/source for each load-bearing claim, staged branch selection via the layered model, and safety refusals (blast-radius + rollback) on high-impact steps.

Status & caveats

  • Prototype, docs-derived. Version-anchored to GPU Operator v26.3.3. The package has not itself been rerun end-to-end after authoring (see its Verification Gap Statement in references/supported-scope.md). This is a review/test draft, not a validated release.
  • Scope is single-node / small K3s clusters with data-center GPUs (Ubuntu 22.04/24.04, K3s/containerd, A100-class). Out of scope: OpenShift OLM, vGPU licensing, confidential containers, Kata, KubeVirt, GPUDirect RDMA/GDS, air-gapped/private-registry flows, managed-cloud cluster creation, and Jetson/integrated-GPU platforms.

Provenance

Generated from a curated source manifest built by reading the public GPU Operator docs in this repository (gpu-operator/, snapshot commit 77a2daaf234a2cebc8e178f24e18cc4a6150e8b1) and the public GPU Operator source at the v26.3.3 release.

A prototype AI DevOps-agent package for the NVIDIA GPU Operator: an AGENTS.md front door + operator skills + references distilled from the public GPU Operator docs and source. It lets an AI coding/ops agent help install, operate, maintain, and troubleshoot the GPU Operator with a probe-first, source-cited, safety-gated operating model.

Docs-derived and version-anchored to GPU Operator v26.3.3. This is a review/test prototype, not a validated release.

Signed-off-by: Andrew Chen <andrewch@nvidia.com>
@github-actions

Copy link
Copy Markdown

Documentation preview

https://nvidia.github.io/cloud-native-docs/review/pr-450

@chenopis chenopis self-assigned this Jul 20, 2026
@chenopis chenopis added feature issue/PR that proposes a new feature or functionality skills AI agent skills labels Jul 20, 2026
@chenopis
chenopis requested review from a-mccarthy and shivakunv July 20, 2026 16:08
A doc-backed uninstall operator skill — Helm release removal, CRD cleanup (operator.cleanupCRD post-delete hook or manual deletion), host driver-module unload (rmmod), and the --no-hooks fallback — grounded in the GPU Operator uninstall documentation. Probe-first preconditions and gated destructive steps.

Signed-off-by: Andrew Chen <andrewch@nvidia.com>
@chenopis
chenopis marked this pull request as ready for review July 20, 2026 23:53
The gpu-operator-uninstall skill was added to the package but the README 'What's in it' table and 'Skill coverage' feedback list still enumerated six skills and omitted it, and the purpose verb-lists dropped removal. Add gpu-operator-uninstall to the README inventory (now seven SOPs) + feedback list, and add 'uninstall' to the README and AGENTS purpose lines so the docs match the package + AGENTS skill-routing table.

Signed-off-by: Andrew Chen <andrewch@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature issue/PR that proposes a new feature or functionality skills AI agent skills

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant