Skip to content

Add Claude Fable 5 eval results #87

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gaojude merged 2 commits into from
Jun 10, 2026
Merged

Add Claude Fable 5 eval results #87

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3223928
Add Claude Fable 5 eval results
gaojude Jun 9, 2026
144f632
Pin eval-cache-check sync to a canary SHA
gaojude Jun 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
7 changes: 6 additions & 1 deletion .github/workflows/eval-cache-check.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,12 @@ jobs:

- run: pnpm install --frozen-lockfile

- run: pnpm sync-evals
# Pinned to the canary commit before agent-040 was renamed
# (unstable_instant -> instant, vercel/next.js#94578 / d424aa8ec4c7).
# Tracking bare `canary` makes this gate red for every PR whenever an eval
# changes upstream until all models are re-run. Bump this SHA in the same
# PR that re-runs the affected eval across all models.
- run: pnpm sync-evals 9e4d718de41bc2bceb687c73c2a60fdf6c5c4440

- name: pnpm eval --dry must show no evals to run
run: |
Expand Down
Loading
Loading