Repository navigation
docs: refresh project status for 2026-09-14 and add a lab briefing - #592
Conversation
README status moves to 2026-09-14 with the measured record kept at its 2026-08-28 snapshot and a new "Since 2026-08-28" block: the SPEC 400-540 pre-registration program (all PROPOSED, nine parked), the unrun causal study (confirmatory v22, pilot v1 zero sessions, pilot v8 collection pending), the ADR-66 pilot-first order, instrument ablations labelled as synthetic or fixture, M3 v2, the local-model floor, and the open external reviews. Adds docs/lab-briefing-2026-09.md for visiting research groups (measured / not measured / how the project is run / positioning / where students can contribute). Refreshes the technical report's snapshot note and Appendix D register, the glossary (pre-registration vocabulary, 4xx/5xx ID prefixes), next-phases ledger, experiments and research-program headers, and the contributor wiki maturity map. Claim catalog snapshot dates follow. No measured result changes; no claim status changes. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_019PJqc15AEfswmRJ8zBhXbk
| <!-- status-snapshot:2026-08-28 canonical:../README.md#status --> | ||
| **Technical framing, August 2026.** Status snapshot: 2026-08-28, commit `93de5e0`; design-doc Phases 2 and 3 closed, the model-tier agenda in §here EXECUTED as Phase 5 (closed 2026-08-27 at measured end-states — VLA competence/latency separated by the lockstep-eval condition, five VLM-judge configurations refused, the env-ladder swap proven mechanically; ledger in [next-phases.md](next-phases.md)), and the hardware entry prepared (ADR-phase6-prep). Any verdict restated here is a dated summary for context; the [README status table](../README.md#status) is canonical and wins on conflict (issue #142). This report states the research object, | ||
| <!-- status-snapshot:2026-09-14 canonical:../README.md#status --> | ||
| **Technical framing, August 2026; snapshot refreshed 2026-09-14, commit `fa339ee`** (no new measured result since 2026-08-28; the pre-registration program and ADR-66's pilot-first order are the delta, summarized in the README). Status snapshot: 2026-08-28, commit `93de5e0`; design-doc Phases 2 and 3 closed, the model-tier agenda in §here EXECUTED as Phase 5 (closed 2026-08-27 at measured end-states — VLA competence/latency separated by the lockstep-eval condition, five VLM-judge configurations refused, the env-ladder swap proven mechanically; ledger in [next-phases.md](next-phases.md)), and the hardware entry prepared (ADR-phase6-prep). Any verdict restated here is a dated summary for context; the [README status table](../README.md#status) is canonical and wins on conflict (issue #142). This report states the research object, |
There was a problem hiding this comment.
[P1] Preserve the post-August measurements in this refreshed snapshot
This says there was "no new measured result since 2026-08-28", but analysis/m3/v2/findings.md is explicitly a measured M3 v2 campaign committed on 2026-08-31 (f002028), and this PR publishes its Spearman 0.746 result in both the README and lab briefing. The new overview is therefore internally contradictory and drops a measurement from the stated delta. Please use the narrower "no new measured hypothesis or ablation result" wording used by the README, or name M3 v2 as the exception.
There was a problem hiding this comment.
Fixed in #593: the snapshot now distinguishes H/A-series results and explicitly names the post-2026-08-28 M3 v2 measurement.
| | M3 environment ladder, v2 | Spearman 0.746 over 16 graphs × 8 seeds | unattested, self-authored population | | ||
|
|
||
| Three observations a lab will care about. Zero wrong-medicine deliveries have | ||
| been observed across every campaign, and the repository refuses to call that |
There was a problem hiding this comment.
[P1] Keep the wrong-object summary within the catalogued evidence
The table above correctly says this is zero in retained denominators, but "across every campaign" turns it into the project-wide assertion that docs/claim-evidence.yaml explicitly says is not supported: the project-wide session denominator is not represented by one independently audited raw table. For CLM-5 consistency, please use the catalog wording (retained development summaries report zero events; prevention is unproven) instead of claiming complete campaign coverage.
There was a problem hiding this comment.
Fixed in #593: the briefing now limits the statement to retained development summaries and states that no independently audited project-wide table exists.
| ## 4. How the project is run, and why it matters for reproducibility | ||
|
|
||
| - Specs carry numbered MUSTs; every MUST needs a test that cites its ID, and | ||
| CI fails otherwise (`tools/trace_check.py`). |
There was a problem hiding this comment.
[P2] Account for explicit traceability waivers
This says CI fails whenever a MUST lacks a citing test, but tools/trace_check.py intentionally honors tools/trace_waivers.toml, and the checker at this head passes with 133 waived MUST IDs. The added glossary repeats the same categorical statement. Please say that every implemented MUST needs a citing test while unimplemented proposed requirements may carry explicit reviewed waivers; otherwise this public briefing overstates current mechanical coverage.
There was a problem hiding this comment.
Fixed in #593: the briefing and glossary now describe explicit reviewable waivers and the stricter behavior of strict gates.
| Forward-looking sections are labelled as such and describe committed design | ||
| direction, not shipped capability.* | ||
| direction, not shipped capability. The measured record in §9 is unchanged | ||
| since this snapshot; what changed afterwards is the pre-registration program |
There was a problem hiding this comment.
[P1] Do not describe the 2026-08-16 snapshot as the unchanged measured record
The sentence says the measured record is unchanged since the 2026-08-16 snapshot and then names only the pre-registration work as the later delta. The canonical README records later measurements, including H6 on 2026-08-26, the Phase-5 results through 2026-08-27, and M3 v2 on 2026-08-31. If section 9 itself is intentionally frozen, please call it a stale historical section and direct readers to the README; otherwise the refreshed preamble incorrectly implies that those measurements never happened.
There was a problem hiding this comment.
Fixed in #593: section 9 is now explicitly labeled as the historical 2026-08-16 snapshot, with H6, Phase 5, and M3 v2 directed to the canonical README.
heyong4725
left a comment
There was a problem hiding this comment.
Codex cross-review: four actionable documentation-integrity findings posted inline (three P1, one P2). The implementation/checker surface is otherwise clean: both hosted unit jobs pass; ruff format/check, claim-evidence check, docs inventory, trace check, and diff check pass in an isolated worktree. The findings concern the omitted post-snapshot measurements, project-wide wrong-object wording beyond the weakened catalog row, and categorical test-coverage wording that omits trace waivers.
docs: correct PR 592 evidence wording
|
P1 — Keep the PR summary aligned with the corrected evidence wording The opening summary now correctly says there is no new H-series hypothesis or A-series ablation result, but the same sentence still concludes that the measured record stays at 2026-08-28 “because nothing has been measured since.” That remains false: M3 v2 is an unattested development measurement committed on 2026-08-31 ( I re-reviewed head |
Summary
Brings the public status surfaces up to date for a presentation to a university research lab. No new H-series hypothesis or A-series ablation result, and no claim status changes; the measured record stays dated 2026-08-28 because nothing has been measured since.
fa339ee); new "Since 2026-08-28" table covering the SPEC 400–540 pre-registration program (all PROPOSED, nine parked under ADR-66), the unrun Pre-register and run the replicated typed-dataflow versus monolithic causal study #347 causal study (confirmatory registration v22 with 7 pending gates; pilot v1 zero sessions and its three blockers; pilot v8 collection pending on fix(harness): bind session audits and reject unsafe loopback authority #589–feat(harness): hidden-access log collected from the macOS sandbox's own denial reports #591; task band v13 BND-7 failed on 22 of 22 strata), the pilot-first order and CON-9 amendment, instrument ablations explicitly labelled synthetic/fixture, M3 v2 (Spearman 0.746, unattested), the local-model floor, ADR-64/spec-change: declared halt contract for motion nodes (SPEC 520 supplement) #562, the PhyAgentOS/TypeGo positioning, and the open external reviews (Arrange the independent statistical review (STA-12) before any confirmatory session #483–Arrange the external benchmark v1 user (BMK-21) #486). Repository map lists the new harness instruments and analysis directories. A pointer to the lab briefing.Not changed:
docs/paper/aisle-paper.md(v1.0, snapshot 2026-08-31; its related-work section already covers PhyAgentOS and TypeGo) and the design doc (frozen pre-registration artifact).Requirement IDs
Docs only (Class A). CLM-8 snapshot markers; CLM-5 wording.
Gates (CON-9 as amended, docs-only)
tools/claim_evidence.py --checkok (release blocker CLM-12 unchanged);tools/docs_inventory.py --checkcurrent;tools/trace_check.pyoktest_claim_evidence,test_exposure_wording,test_docs_inventoryand neighbours, 133 passedTest plan
🤖 Generated with Claude Code
https://claude.ai/code/session_019PJqc15AEfswmRJ8zBhXbk