+A previously unseen GitHub CPU still fails the required check. Instead of failing before measurement, the harness collects nine independent launches per case and uploads a CPU-enforced candidate plus raw results. Validate it with at least two independent hosted runs of the same performance-relevant revision; baseline-only changes do not invalidate confirmation. The second candidate must pass the first candidate's two-sided contract with no per-case or aggregate failures. Record the workflow, job, revision, and held-out ratios in the profile provenance before adding the candidate under its suggested deterministic profile name. The unknown hardware cannot pass until that profile is checked in.
0 commit comments