Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
dd5dc69
docs: add Approach A design spec for skill improvements
hiepau1231 Mar 22, 2026
2895636
docs: add Approach A implementation plan
hiepau1231 Mar 22, 2026
740224e
chore: ignore .worktrees/ directory
hiepau1231 Mar 22, 2026
dd03b45
fix(security-review): remove phantom AskUserQuestion from Phase 1 Step 1
hiepau1231 Mar 22, 2026
1351ab4
fix(security-review): replace inline output format with {OUTPUT_FORMA…
hiepau1231 Mar 22, 2026
9a14804
fix(pr-review,parallel-review): fix $SCOPE undefined and invalid suba…
hiepau1231 Mar 22, 2026
edce2e4
fix(security-review): remove archive step, code-edit instruction, uni…
hiepau1231 Mar 22, 2026
c4af0c5
feat(security-review): add prompt assembly step and claude-analysis-t…
hiepau1231 Mar 22, 2026
9da6bc7
fix(security-review): correct Step 1.8 heading level and position ins…
hiepau1231 Mar 22, 2026
4f974fb
feat(plan-review): add information barrier Step 2.5 and cross-analysi…
hiepau1231 Mar 22, 2026
606cff7
feat(impl-review): add information barrier Step 2.5 and cross-analysi…
hiepau1231 Mar 22, 2026
9f14be7
feat(security-review): add information barrier Step 2.5 and FINDING/I…
hiepau1231 Mar 22, 2026
8c153bc
fix(security-review): unify VERDICT vocabulary to CONSENSUS/CONTINUE/…
hiepau1231 Mar 22, 2026
f3e0384
fix(plan-review): unify VERDICT vocabulary to CONSENSUS/CONTINUE/STAL…
hiepau1231 Mar 22, 2026
bd3c43a
fix(impl-review): unify VERDICT vocabulary to CONSENSUS/CONTINUE/STAL…
hiepau1231 Mar 22, 2026
aac3242
fix(security-review): resolve nested fence corruption, STALEMATE gate…
hiepau1231 Mar 22, 2026
9ae69ee
fix(security-review): invert pre-commit gate to fail-closed
hiepau1231 Mar 22, 2026
e814068
fix(security-review): close remaining gate bypasses and align verdict…
hiepau1231 Mar 22, 2026
5fa2466
fix(security-review): resolve grep fail-open and output-format nested…
hiepau1231 Mar 22, 2026
95e6d02
fix(security-review): resolve prompt assembly, base branch, and forma…
hiepau1231 Mar 22, 2026
b208ec5
fix(security-review): align SKILL.md with review-only behavior
hiepau1231 Mar 22, 2026
2807f6f
docs: update plan with actual implementation details
hiepau1231 Mar 22, 2026
50b68a2
Merge feature/approach-a-skill-improvements: Complete Approach A skil…
hiepau1231 Mar 22, 2026
d581875
docs: add PR description for Approach A implementation
hiepau1231 Mar 22, 2026
d4c038b
Merge origin/main: Integrate v13 runner-centric architecture with App…
hiepau1231 Mar 22, 2026
137c287
feat: port Approach A information barrier to v13 SKILL.md structure
hiepau1231 Mar 22, 2026
e1cbf88
fix: unify VERDICT vocabulary in SKILL.md Final Output sections
hiepau1231 Mar 22, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,9 @@ node_modules/
.DS_Store
.gitnexus

# Git worktrees
.worktrees/

# Working documents (project-level, not shipped)
SESSION_SUMMARY.md
PROGRESS_REPORT.md
Expand Down
102 changes: 102 additions & 0 deletions PR_DESCRIPTION.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
# Complete Approach A Skill Improvements

## Summary

Implements all 12 tasks from [Approach A implementation plan](docs/superpowers/plans/2026-03-22-approach-a-skill-improvements.md):
- Fixed 5 critical bugs across multiple review skills
- Added information barrier pattern to 3 review skills
- Unified VERDICT vocabulary across all review skills

**Total changes**: 13 files, +287/-168 lines, 18 commits

## Changes by Category

### 1. Bug Fixes (5 bugs resolved)

#### security-review
- **Bug 1**: Removed phantom `AskUserQuestion` from Phase 1 Step 1
- **Bug 2**: Replaced inline output format with `{OUTPUT_FORMAT}` placeholder to prevent nested fence corruption
- **Bug 3**: Removed archive step and code-edit instruction from workflow
- **Bug 4**: Fixed heading level for Step 1.8 (was H2, should be H3)

#### pr-review & parallel-review
- **Bug 5**: Fixed `$SCOPE` undefined error and invalid `subagent_type` parameter

### 2. Information Barrier Implementation (3 skills)

Added independent analysis phase (Step 2.5) before polling Codex output:

- **security-review**: Claude analyzes code independently using OWASP/CWE checklist, produces FINDING-{N} list, then cross-analyzes with Codex's ISSUE-{M} list
- **plan-review**: Claude reviews plan independently, produces FINDING-{N} list, then cross-analyzes with Codex's ISSUE-{M} list
- **impl-review**: Claude reviews code independently, produces FINDING-{N} list, then cross-analyzes with Codex's ISSUE-{M} list

Created `claude-analysis-template.md` with structured format for independent analysis and cross-analysis mapping.

### 3. VERDICT Vocabulary Unification (3 skills)

Changed from `APPROVE | REVISE` to `CONSENSUS | CONTINUE | STALEMATE`:

- **security-review**: Updated SKILL.md, workflow.md, prompts.md, output-format.md
- **plan-review**: Updated workflow.md, prompts.md, output-format.md
- **impl-review**: Updated workflow.md, prompts.md, output-format.md

## Additional Fixes (6 rounds of codex-impl-review)

After completing the 12 planned tasks, ran adversarial review which identified and fixed:

### Round 1-3: Nested Fence Corruption & Gate Bypass
- Removed outer fence wrappers from Round 1 and Round 2+ prompt templates
- Removed outer fences from example sections in prompts.md
- Updated pre-commit hook to check both CONTINUE and STALEMATE verdicts
- Added verdict counting (requires exactly 1 verdict AND it must be CONSENSUS)

### Round 4: Fail-Open Gate & Output Format Fences
- Fixed grep -c fail-open issue by switching to awk-based counting with explicit zero normalization
- Removed outer fences from output-format.md examples (Complete Security Finding, Secrets Detection, Response Format)

### Round 5: Prompt Assembly & Base Branch Discovery
- Clarified prompt assembly to extract only Round 1 section (exclude Round 2+ sections)
- Added base branch auto-discovery (Step 1) before validation (Step 2)
- Removed stray closing fence after Response Format (Round 2+)
- Fixed Status column reference in claude-analysis-template.md

### Round 6: Review-Only Behavior Alignment
- Fixed SKILL.md step 6 contradiction: changed from "Fix valid vulnerabilities in code" to "Validate findings, prepare rebuttals or severity adjustments, and provide evidence without editing code"
- Aligns with review-only contract throughout all documentation

## Final State

✅ All nested fence corruption eliminated
✅ Pre-commit gate is truly fail-closed with awk-based counting
✅ Category taxonomy aligned across all security-review files
✅ VERDICT vocabulary unified (CONSENSUS|CONTINUE|STALEMATE)
✅ Prompt assembly extracts only Round 1 section
✅ Base branch discovery happens before validation
✅ All skill files internally consistent
✅ Review-only behavior consistent throughout

## Files Changed

```
skill-packs/codex-review/skills/codex-impl-review/references/output-format.md
skill-packs/codex-review/skills/codex-impl-review/references/prompts.md
skill-packs/codex-review/skills/codex-impl-review/references/workflow.md
skill-packs/codex-review/skills/codex-parallel-review/references/workflow.md
skill-packs/codex-review/skills/codex-plan-review/references/output-format.md
skill-packs/codex-review/skills/codex-plan-review/references/prompts.md
skill-packs/codex-review/skills/codex-plan-review/references/workflow.md
skill-packs/codex-review/skills/codex-pr-review/references/workflow.md
skill-packs/codex-review/skills/codex-security-review/SKILL.md
skill-packs/codex-review/skills/codex-security-review/references/claude-analysis-template.md (new)
skill-packs/codex-review/skills/codex-security-review/references/output-format.md
skill-packs/codex-review/skills/codex-security-review/references/prompts.md
skill-packs/codex-review/skills/codex-security-review/references/workflow.md
```

## Testing

All changes verified through 6 rounds of adversarial review using `/codex-impl-review`. Final review found only 2 minor edge cases (branch auto-detection without upstream, Round 2 workflow clarity) which are documented but not blocking.

## Breaking Changes

None. All changes are internal improvements to skill implementation. The skill invocation interface (`/codex-security-review`, `/codex-plan-review`, `/codex-impl-review`) remains unchanged.
Loading