Skip to content

fix: clarify run detail result metrics - #5

Open
pppolf wants to merge 10 commits into
mainfrom
codex/complete-evaluation-workflow
Open

fix: clarify run detail result metrics#5
pppolf wants to merge 10 commits into
mainfrom
codex/complete-evaluation-workflow

Conversation

@pppolf

@pppolf pppolf commented Aug 30, 2026

Copy link
Copy Markdown
Member

Summary

  • distinguish unscored answers, ordinary wrong answers, and execution errors in Run Detail
  • expose Run-wide known input/output token subtotals and independent coverage on the paginated Responses API
  • preserve protocol-v1 exact-token null semantics while showing explicitly incomplete evidence

Validation

  • make lint
  • make test (backend 951 passed, 33 skipped; frontend 47 passed)
  • make smoke
  • frontend production build
  • docker compose config --quiet
  • target Run verified through the local API and browser UI

No real Provider was called and no historical data or schema was modified.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant