[lucasbraum]

UPT-86. Breaking recall 54% → 65% (44 → 55 TP, 38 → 30 FN), 0 breaking FP. Ground truth and thresholds unchanged.

Part 1: 66 vs 44

44 / 0 / 38 is the number. A clean local run (packs:fetch, pack test zod) and CI's pack zod job on main (4c3dc23, run 39009240360) agree exactly. The recorded 66 / 0 / 37 does not reproduce, not even at its own commit: 9039e3c (#156) scores 38 / 0 / 37 here.

What I could establish: breaking TP counts only sites check reports at breaking. For vzdc-artcc/website, 0 of its breaking sites are TP: its findings come back unverified with "57 of 95 files cannot resolve their imports; compile signal skipped". The files import @/generated/prisma/*, which prisma generate writes in a postinstall, and ground-truth installs run scripts off. tsc on the cached checkout confirms 234 TS2307 on those paths. #156 predicted this ("probably caused by the Prisma client"). I did not run prisma generate, so I could not show that a generated client yields 66; I believe that is the difference, but it is not demonstrated. The unverified findings cost recall, not precision.

verification.json is regenerated from the run (--write); docs:packs updated README and compatibility. The README's 64% → 65% looks like a one-point gain; against what CI measures, the gain is 54% → 65%.

Part 2: recall

Reach first: of the 38 misses, 33 are in files that import zod directly (the scan reads them); 5 are not (import("zod").X only, LessonForm.tsx reading error.errors with no zod import). The misses are rule gaps, not unread files.

group	misses	cause
root exports now only in zod/v3 (SafeParseReturnType, ZodTypeDef, ZodEffects)	15 (7 FN here; 8 already seen as types)	fixed: the diff counts them as unchanged because exportedFrom overlaps on ./v3
.refine(fn, { message }) → error	6	not done: deprecated, still compiles; needs a detect rule on the second argument
compiler-only TS2322/TS2345 flowing across files (PATH post-runs, resume-run; band server, sse, stdio)	10	not done: no zod API at the line
import("zod").ZodTypeAny and ZodRawShape/_def/ZodOptional name checks	8	not done: deprecated names, _def reads
errorMap / ctx.defaultError	2	not done

rule	before TP/FP/FN	after
removed-exports (new)	n/a	7 / 8 / 0 (all 15 on truth lines; 8 labelled types there, so counted as a wrong rule)
generic	82 / 534 / 26	82 / 527 / 19
error-params, error-issues, string-format, record-key	unchanged	unchanged
breaking	44 / 0 / 38	55 / 0 / 30

uuid() → guid() (the calmcp case): string-format wrote z.uuid(), which in zod 4 also checks the RFC version and variant; zod 3 accepted any 8-4-4-4-12 hex id. It now writes z.guid(). Decision for you: the public upgrades in the truth mostly use z.uuid(); I chose behaviour preservation. Fixture and guide updated; line-level scores unchanged.

Checks: biome and tsc clean; pack unit tests pass except scaffold.test.ts and pack-test.test.ts "each companion", which fail on a clean main here too.

🤖 Generated with Claude Code