Skip to content

Add deterministic baseline-to-candidate regression gate - #18

Open
GenRamzi wants to merge 20 commits into
mainfrom
feat/regression-gate
Open

GenRamzi wants to merge 20 commits into
mainfrom
feat/regression-gate

Conversation

@GenRamzi

@GenRamzi GenRamzi commented Sep 23, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • add skillconform.regression/v1
  • add regress <candidate> --baseline <path>
  • detect newly introduced findings and trust-surface expansion without executing target scripts
  • compare network, shell, bundled scripts, tool permissions, network hosts, added/removed skills, and resolved findings
  • add TypeScript API and GitHub Action regression mode
  • document a safe side-by-side pull-request checkout workflow
  • fix network host normalization in capability inventory
  • move the development line to 0.4.0 and update the changelog
  • migrate the release workflow from long-lived NPM_TOKEN publishing to npm Trusted Publishing/OIDC (Node 24 + npm 11.15+)
  • document the one-time npm Trusted Publisher setup required for GenRamzi/skillconform

Safety boundary

This gate performs static analysis only. Capability expansion is evidence for review, not a claim of malicious behavior. Runtime/live agent evaluation remains a separate future evidence layer.

Release note

v0.2.0 and v0.3.0 validation passed but their npm publish jobs were rejected at registry authentication. This PR fixes the GitHub workflow side; npmjs.com still needs the one-time Trusted Publisher authorization for release.yml before v0.4.0 can publish.

Comment thread test/regression.test.ts
assert.ok(codes.has("REG013"));
assert.ok(codes.has("REG001"));
const hostChange = result.changes.find((item) => item.code === "REG014");
assert.equal(hostChange?.message.includes("example.com"), true);
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants