Repository navigation

Add a spoken-punctuation eval, and freeze its dataset in the repo - #164

Closed

alexkroman wants to merge 8 commits into

mainfrom

eval/spoken-punctuation

Closed

Add a spoken-punctuation eval, and freeze its dataset in the repo#164
alexkroman wants to merge 8 commits into
mainfrom
eval/spoken-punctuation

Commits on Aug 26, 2026
- feat: add a spoken-punctuation eval and freeze its dataset
  
  alexkroman-assembly
  and
  claude
  committed
  f6150a0
- feat: weight leftover punctuation commands, and exercise the capital after one
  
  alexkroman-assembly
  and
  claude
  committed
  46e8275
- feat: score the punctuation commands and nothing else
  
  alexkroman-assembly
  and
  claude
  committed
  21851ee
- feat: let a search resume a ranking instead of re-paying for it
  
  alexkroman-assembly
  and
  claude
  committed
  9dcee7c
- fix: wait out the datasets-server's intermittent 500s
  
  alexkroman-assembly
  and
  claude
  committed
  cff80be
- fix: score the seed on dev when the sweep deliberately skipped it
  
  alexkroman-assembly
  and
  claude
  committed
  3a8a284
- feat: let a round's winner become the next round's bar
  
  alexkroman-assembly
  and
  claude
  committed
  f25a307
- feat: report per-utterance failure, not only per-command means
  
  alexkroman-assembly
  and
  claude
  committed
  9234f6f