Plan: agent eval suite (Gap #3), with ADR-01 on architecture - #47

Merged

AniketTati merged 16 commits into

mainfrom

feat/agent-eval-plan

Aug 8, 2026

Commits on Aug 8, 2026

Plan the eval suite, and correct the audit it comes from
AniketTati
committed
d8d802b
ADR-01: one suite, three tiers, JavaScript, with record/replay
AniketTati
committed
710c84c
Correct an over-clean claim in ADR-01, and record a CI enabler
AniketTati
committed
55c5e5c
Wave A: an eval gate that can fail, proven four ways
AniketTati
committed
0eae9a8
Wave B: report which model actually answered, and stop discarding pins
AniketTati
committed
f331ecb
E13: stop discarding model pins on single-key deployments
AniketTati
committed
d1fc946
E12: a record/replay seam that runs with no API key at all
AniketTati
committed
4154ca1
E12 complete: tool-call replay works, and my earlier diagnosis was wrong
AniketTati
committed
585daf5
Waves C and D: one suite, and an identity that cannot bill a customer
AniketTati
committed
5bb857f
The gate's first real run caught my own false claim
AniketTati
committed
96cae07
Make the checks portable, and stop guessing at what CI will do
AniketTati
committed
e88a21b
Add preflight: run the suite the way CI will, before pushing
AniketTati
committed
6300e6d
Record the Wave E path: promote security checks from nightly to every PR
AniketTati
committed
b82774a
Correct the Wave E effort estimate before anyone plans on it
AniketTati
committed
4703d99
Take both open calls: honour model pins, and sequence tier-2 CI
AniketTati
committed
1080695
Pin the coupling that keeps the web UI working after E13
AniketTati
committed
e017a2d