Skip to content

Evaluation: the owner signs the triage-precision bars - #22

Merged
tom-snyder merged 1 commit into
mainfrom
chore/sign-triage-bars
Oct 4, 2026
Merged

tom-snyder merged 1 commit into
mainfrom
chore/sign-triage-bars

Conversation

@tom-snyder

Copy link
Copy Markdown
Member

The owner's signature on the triage-precision row's bars, before any model ran (2026-10-04).

  • Pass: the plausible verdict's precision interval (Wilson 95%, function label) has a lower bound of at least 0.75, raised by the owner from the proposed bar (above the sample's base rate, 0.415), and at least half of the labelled false positives are dropped.
  • Fail: the interval's upper bound is at or below the base rate.
  • Anything between the two is AMBIGUOUS.

eval/register.yaml only; the row's decision is untouched. Eval tests pass (168).

Pass: the plausible verdict's precision interval (Wilson 95%, function
label) has a lower bound of at least 0.75, raised by the owner from the
proposed bar (above the sample's base rate, 0.415), and at least half of
the labelled false positives are dropped. Fail: the interval's upper bound
is at or below the base rate. Signed on 2026-10-04, before any model ran;
the row's decision is untouched.
@tom-snyder
tom-snyder merged commit 6db64aa into main Oct 4, 2026
8 checks passed
@tom-snyder
tom-snyder deleted the chore/sign-triage-bars branch October 4, 2026 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant