Add tuning runs for custom metrics - #2470

Merged

akwasigroch merged 6 commits into

feat/metric-tuning-test-setsfrom

feat/tuning-run-metric

Aug 13, 2026

Commits on Aug 13, 2026

feat(backend): run a metric over its tuning cases
Arkadiusz Kwasigroch
committed
e779825
test(backend): cover tuning runs
Arkadiusz Kwasigroch
committed
f343b93
feat(frontend): show what the metric said about each case
Arkadiusz Kwasigroch
committed
e2c2c60
feat(backend): pick the tuning run's judge model explicitly
Arkadiusz Kwasigroch
committed
a97fb4c
fix(backend): count a failed metric call as an errored case
Arkadiusz Kwasigroch
committed
df6052d
fix(backend): stop a tuning verdict being invented from a string
Arkadiusz Kwasigroch
committed
09b23aa