-
Notifications
You must be signed in to change notification settings - Fork 0
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Tracker: gold-standard publication push (waves, dependencies, definition of done)
theme/pub-infraCards, publish pipeline, CI, held-out disciplineCards, publish pipeline, CI, held-out disciplineStatus: Open.#21 In caiotheodoro/reconforge;Multi-seed eval matrix (seeds 7/13/42 + frozen test seed): across-seed and sampling variance next to bootstrap CIs
cost/T2-computeNew model or API runsNew model or API runstheme/benchmark-validityMetric, CI, contamination, taxonomy soundnessMetric, CI, contamination, taxonomy soundnessStatus: Open.#20 In caiotheodoro/reconforge;Floors and ceilings: trivial-policy + rules-oracle baselines (spec §11.3) with skill-normalized scores
cost/T2-computeNew model or API runsNew model or API runstheme/headline-integrityDoes the headline claim survive scrutinyDoes the headline claim survive scrutinyStatus: Open.#19 In caiotheodoro/reconforge;Decisive rerun: head-to-head with rubric-defined PARTIAL_MATCH + matched 5-vote budget for DeepSeek (pre-registered outcomes)
cost/T2-computeNew model or API runsNew model or API runstheme/headline-integrityDoes the headline claim survive scrutinyDoes the headline claim survive scrutinyStatus: Open.#18 In caiotheodoro/reconforge;PARTIAL_MATCH construct validity: 32 eval items from 9 hard-coded string pairs shared with training — hold out variants
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/headline-integrityDoes the headline claim survive scrutinyDoes the headline claim survive scrutinyStatus: Open.#17 In caiotheodoro/reconforge;FIELD_CORRUPTION vs VALUE_DATE taxonomy collision: quantify, fix generator/scoring, correct the B2 narrative
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/benchmark-validityMetric, CI, contamination, taxonomy soundnessMetric, CI, contamination, taxonomy soundnessStatus: Open.#16 In caiotheodoro/reconforge;CI: tests, metric re-derivation from committed exports, card YAML validation, Quick Start snippet checks
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/pub-infraCards, publish pipeline, CI, held-out disciplineCards, publish pipeline, CI, held-out disciplineStatus: Open.#15 In caiotheodoro/reconforge;Bring hf-publish/ staging into the repo: single-source cards, publish script, drift check
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/pub-infraCards, publish pipeline, CI, held-out disciplineCards, publish pipeline, CI, held-out disciplineStatus: Open.#14 In caiotheodoro/reconforge;Pin the evidence chain: commit training logs, tag the scoring-code state, record adapter SHA-256 + Hub revision
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/provenanceWhich weights, seeds, numbers actually produced published resultsWhich weights, seeds, numbers actually produced published resultsStatus: Open.#13 In caiotheodoro/reconforge;Write up: validation loss carries no selection signal (B2 vs run-1 — identical val loss, 19-point R_w gap)
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/benchmark-validityMetric, CI, contamination, taxonomy soundnessMetric, CI, contamination, taxonomy soundnessStatus: Open.#12 In caiotheodoro/reconforge;Scoring-harness bugs: whole-JSON majority vote, miscomputed exception_type_accuracy, degenerate escalation precision, 31/37 wording
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/benchmark-validityMetric, CI, contamination, taxonomy soundnessMetric, CI, contamination, taxonomy soundnessStatus: Open.#11 In caiotheodoro/reconforge;Near-dup honesty: publish dedup sensitivity (scores rise), reframe 'zero contamination', fix tautological ROC claim
cost/T1-cheapScripts or re-scoring from existing exportsScripts or re-scoring from existing exportstheme/benchmark-validityMetric, CI, contamination, taxonomy soundnessMetric, CI, contamination, taxonomy soundnessStatus: Open.#10 In caiotheodoro/reconforge;