[gitAbid]

WP-10: Evals + cutover

Eval gate — deterministic gates PASSING, judge honestly BLOCKED (owner keys)

pnpm --dir web eval over 8 transcripts (web/evals/transcripts/: the real demo sample + 7 clearly-labelled synthetic fixtures standing in for self-recorded/CC0 until the owner supplies real ones — drop-in replaceable):

• Quote integrity 100% — every quote in every artifact is a verbatim 40–240-char transcript slice (the quotes artifact must carry ≥1; embedded refs that exist are verified)
• Banned-word leaks 0 (neverSay + religion-neutral framing gate over all generated content)
• Limit compliance 100% (AI content: full §7.2 Zod; fallback content: §7.2 caps — per the WP-03/04 no-padding decision)
• p90 ≪ 5 min · cost $0.000/episode (deterministic fallback; live cost gate activates with real keys)
• LLM-judge: BLOCKED, not faked — no valid AI keys exist yet (the env GLM key is a placeholder that 401s); the runner reports the blocker and will score faithfulness/usefulness the moment keys land (FOR-ABID.md §2). "Owner would-publish" check is on CUTOVER-CHECKLIST.md.

Cutover — scripted, deliberately NOT executed

• scripts/cutover.sh: env gate → git mv site/ api/ engine/ → legacy/ → drop legacy vercel.json → prints the Vercel steps. Not run: the live deployment still serves from repo root, and the new app cannot sign users up until the owner adds Clerk/Neon (fail-closed by design).
• docs/relaunch/CUTOVER-CHECKLIST.md: preconditions (env check + live eval gate + owner package review), execution steps, post-cutover verification list.
• web/scripts/verify-env.mjs: §9 env verification (required vs optional, per project/env) — the new counterpart of scripts/verify-unlocks.mjs.

Verification on this branch

pnpm lint 0 errors · pnpm typecheck clean · pnpm test 466 passed / 2 skipped (2 new eval-gate tests) · keyless e2e 38 passed · DB-mode e2e 8 passed · pnpm build ✓ · preview https://episodekit-i8pimmxr1-pera-byte.vercel.app (200)

Decisions logged (3 entries)

Synthetic stand-in transcripts (documented, replaceable); fallback held to limits+verbatim rules but not AI count-minima; cutover gated not executed.

Blocked on owner (top of FOR-ABID.md)

Valid GLM + Groq keys (judge gate + live AI), Clerk + Neon + Blob (sign-up/audio), Lemon Squeezy (checkout). Everything else in the MVP is built and green.