docs(#3508): add AGENTS.md review guidance for smoke-tests-native - #3510
docs(#3508): add AGENTS.md review guidance for smoke-tests-native#3510fullsend-ai-coder[bot] wants to merge 1 commit into
Conversation
Add a new "Reviewing smoke-tests-native Changes" section to AGENTS.md after the E2E Nightly Fix Conventions section. This gives the review agent domain-specific criteria for evaluating changes to the smoke-tests-native validation harness, covering three areas: - Untrusted input handling: adversarial filesystem paths (NUL bytes, overlong names, empty strings), typeof-array gotcha, and per-plugin error isolation to prevent sweep-level crashes - Consumer-path verification: ensuring validation targets match what the RHDH runtime actually reads (e.g. dist-scalprum/configSchema.json vs the CLI default dist/.config-schema.json) - Error propagation: distinguishing I/O errors from "not declared" or "not found" to avoid swallowing real problems This parallels the existing "Major Version Bumps in Patches" section which provides equivalent domain-specific review criteria for dependency patches. The guidance is derived from 12 bugs self-found during PR #3486 review, where the review bot had zero correctness findings across 5 review runs due to lack of subsystem context. Closes #3508
|
Hi @fullsend-ai-coder[bot]. Thanks for your PR. I'm waiting for a redhat-developer member to verify that this patch is reasonable to test. If it is, they should reply with Regular contributors should join the org to skip this step. Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
|
🤖 Finished Review · ✅ Success · Started 8:13 PM UTC · Completed 8:17 PM UTC Commit: Runtime: claude · Model: opus → claude-opus-4-6 · Cost: $0.78 |
Review — approveConfidence: high This PR adds a well-structured "Reviewing smoke-tests-native Changes" section to AGENTS.md, providing domain-specific review guidance for the Verification of technical claimsAll six key assertions in the new guidance were cross-referenced against
Structure and placementThe new section is inserted between "E2E Nightly Fix Conventions" and "Documentation" — a logical location that keeps domain-specific review guidance grouped. The three subsections (untrusted input handling, consumer-path verification, error propagation) parallel the structure of the existing "Major Version Bumps in Patches" section, which provides equivalent criteria for dependency patches. Scope assessmentThe change is documentation-only (20 additions, 0 deletions, single file). It does not modify any code, configuration, or CI workflows. The guidance is accurate, actionable, and appropriately scoped to the No findings.
|



Add a new "Reviewing smoke-tests-native Changes" section to AGENTS.md after the E2E Nightly Fix Conventions section. This gives the review agent domain-specific criteria for evaluating changes to the smoke-tests-native validation harness, covering three areas:
overlong names, empty strings), typeof-array gotcha, and per-plugin
error isolation to prevent sweep-level crashes
the RHDH runtime actually reads (e.g. dist-scalprum/configSchema.json
vs the CLI default dist/.config-schema.json)
or "not found" to avoid swallowing real problems
This parallels the existing "Major Version Bumps in Patches" section which provides equivalent domain-specific review criteria for dependency patches. The guidance is derived from 12 bugs self-found during PR #3486 review, where the review bot had zero correctness findings across 5 review runs due to lack of subsystem context.
Closes #3508
Post-script verification
agent/3508-smoke-tests-native-guidance)f0072e14593191839651d4f8a5bd3b27a604d860..HEAD)