Skip to content

feat: harden format-aware scanning and Skill-Inject benchmarking#22

Merged
charliechenye merged 16 commits into
mainfrom
skill-inject-benchmark-hardening
Jul 13, 2026
Merged

feat: harden format-aware scanning and Skill-Inject benchmarking#22
charliechenye merged 16 commits into
mainfrom
skill-inject-benchmark-hardening

Conversation

@charliechenye

Copy link
Copy Markdown
Owner

Summary

  • Add bounded logical source spans for wrapped and malformed content.
  • Preserve raw source hashes, evidence, line locations, and existing output contracts.
  • Resolve wrapped script references safely within known directories.
  • Add opt-in --format-aware scanning for scan, check, and diff.
  • Add local-only Skill-Inject differential benchmarking with controls and regression gates.
  • Add mal-format fixtures and documentation.

Validation

  • 40 focused tests passed.
  • Ruff checks passed.
  • Formatting checks passed.
  • Snapshot checks passed.
  • npm tests passed.
  • Skill-Inject benchmark remains at 77/84 cases with any signal and 14/84 with high/critical signal.

Safety and compatibility

  • No payloads, agents, Docker containers, or network connections are used by the benchmark path.
  • Existing physical line scanning remains the default.

Comment thread tests/test_discovery_and_rules.py Fixed
@charliechenye charliechenye merged commit 66b730d into main Jul 13, 2026
5 checks passed
@charliechenye charliechenye deleted the skill-inject-benchmark-hardening branch July 13, 2026 23:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants