Add evaluation contracts to fix backwards adversarial scoring - #2580

Merged

harry-rhesis merged 18 commits into

mainfrom

adversarial-goal-achievement

Aug 25, 2026

Commits on Aug 24, 2026

feat(backend): add test evaluation contracts
harry-rhesis
committed
6ba3325
feat(backend): add interpretation endpoint
harry-rhesis
committed
8d9e872
feat(sdk): score against evaluation contract
harry-rhesis
committed
b67ed7d
feat: drive penelope from the evaluation contract
harry-rhesis
committed
fa20c33
feat(backend): thread contract through execution
harry-rhesis
committed
adf2932
feat(frontend): show behaviour compliance
harry-rhesis
committed
ddd7199
feat(sdk): state the boundary in generated tests
harry-rhesis
committed
5b86607
docs: document evaluation contracts
harry-rhesis
committed
a432111
fix(sdk): unify goal-achievement threshold at 0.7
harry-rhesis
committed
f534b3f
fix(sdk): stop judges from sampling
harry-rhesis
committed
d76d22b
fix(frontend): stop test edits from dropping config keys
harry-rhesis
committed
88dcd8f
chore(dev): remove orphaned goal_evaluation prompt
harry-rhesis
committed
e1d206f
style: fix formatting flagged by CI lint
harry-rhesis
committed
b4b2953
fix(backend): treat confidence exactly at the floor as unusable
harry-rhesis
committed
d8395e1
docs(backend): clarify two contract lifecycle invariants
harry-rhesis
committed
6f7d4fa
fix(backend): discard re-score results against a stale contract
harry-rhesis
committed
031980b
refactor(sdk): rename verdict-alignment tracking set for clarity
harry-rhesis
committed
86def2c
feat(backend): surface why a re-scored result has no metrics
harry-rhesis
committed
4e288f1