Docs-stats verify gate: README/site numbers vs live registry (N8)#13
Merged
Conversation
New gpu_stack/docs_stats_check.py compares the claim surfaces against live registry truth computed at runtime: - README.md Current Snapshot table rows and the stats code block - docs/index.html stat-grid values - docs/app.js embedded fact-string literals Mismatches report file, claim, expected (live), and found (document), with a nonzero exit. Wired as a fifth docs-stats gate in the full verify profile, naturally read-only safe. Runnable directly via python -m gpu_stack.docs_stats_check (currently: docs-stats: OK). Tests derive expectations from the live Registry at test time and exercise planted-drift failures on tmp copies, never the real files. Full pytest: 684 passed. https://claude.ai/code/session_01Eu2JVnPFgMQftwYTP3cGQZ
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
N8 of 10: Docs-freshness verify gate
This session's earlier polish wave found broken README snippets and stale stats in six different ledger files — drift is the failure mode of this repo's exact-observed-numbers culture. This PR makes stat drift unmergeable.
What it does
New
gpu_stack/docs_stats_check.pycompares the claim surfaces against live registry truth computed at runtime:README.md"Current Snapshot" table rows and the stats code blockdocs/index.htmlstat-grid valuesdocs/app.jsembedded fact-string literalsMismatches report file, claim, expected (live), found (document), with nonzero exit. Wired as a fifth
docs-statsgate in the full verify profile (naturally read-only safe). Also runnable directly:python -m gpu_stack.docs_stats_check→ currentlydocs-stats: OK.Design point
Tests derive expectations from the live Registry at test time (never hardcoded numbers) and exercise planted-drift failures on tmp copies — so this gate stays correct as sibling PRs change registry contents. After merging the registry-touching PRs (N1/N2/N5), this gate will correctly fail until README/site numbers are regenerated; that refresh is part of the integration pass.
Verification
docs-stats: OKNote: agent was interrupted by a session limit after implementation+tests; coordinator validated, committed, and pushed.
https://claude.ai/code/session_01Eu2JVnPFgMQftwYTP3cGQZ
Generated by Claude Code