Skip to content

docs: refresh project status for 2026-09-14 and add a lab briefing - #592

Merged
heyong4725 merged 3 commits into
mainfrom
docs/status-2026-09-14
Sep 14, 2026
Merged

heyong4725 merged 3 commits into
mainfrom
docs/status-2026-09-14

Conversation

@heyong4725

@heyong4725 heyong4725 commented Sep 14, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Brings the public status surfaces up to date for a presentation to a university research lab. No new H-series hypothesis or A-series ablation result, and no claim status changes; the measured record stays dated 2026-08-28 because nothing has been measured since.

Not changed: docs/paper/aisle-paper.md (v1.0, snapshot 2026-08-31; its related-work section already covers PhyAgentOS and TypeGo) and the design doc (frozen pre-registration artifact).

Requirement IDs

Docs only (Class A). CLM-8 snapshot markers; CLM-5 wording.

Gates (CON-9 as amended, docs-only)

  • ruff format --check, ruff check
  • tools/claim_evidence.py --check ok (release blocker CLM-12 unchanged); tools/docs_inventory.py --check current; tools/trace_check.py ok
  • Doc-policing unit tests: test_claim_evidence, test_exposure_wording, test_docs_inventory and neighbours, 133 passed
  • All relative links and cited paths resolve; every issue cited as open is open
  • Factual review against the repository: every number verified; one stale figure fixed (perception audit now cites the hardened second audit, 22 of 22 strata, not the superseded n=80 run)

Test plan

  • CI green
  • Owner read of the lab briefing before the presentation

🤖 Generated with Claude Code

https://claude.ai/code/session_019PJqc15AEfswmRJ8zBhXbk

README status moves to 2026-09-14 with the measured record kept at its
2026-08-28 snapshot and a new "Since 2026-08-28" block: the SPEC 400-540
pre-registration program (all PROPOSED, nine parked), the unrun causal study
(confirmatory v22, pilot v1 zero sessions, pilot v8 collection pending), the
ADR-66 pilot-first order, instrument ablations labelled as synthetic or
fixture, M3 v2, the local-model floor, and the open external reviews.

Adds docs/lab-briefing-2026-09.md for visiting research groups (measured /
not measured / how the project is run / positioning / where students can
contribute). Refreshes the technical report's snapshot note and Appendix D
register, the glossary (pre-registration vocabulary, 4xx/5xx ID prefixes),
next-phases ledger, experiments and research-program headers, and the
contributor wiki maturity map. Claim catalog snapshot dates follow.

No measured result changes; no claim status changes.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019PJqc15AEfswmRJ8zBhXbk
@heyong4725 heyong4725 added the documentation Improvements or additions to documentation label Sep 14, 2026
Comment thread docs/research-program.md Outdated
<!-- status-snapshot:2026-08-28 canonical:../README.md#status -->
**Technical framing, August 2026.** Status snapshot: 2026-08-28, commit `93de5e0`; design-doc Phases 2 and 3 closed, the model-tier agenda in §here EXECUTED as Phase 5 (closed 2026-08-27 at measured end-states — VLA competence/latency separated by the lockstep-eval condition, five VLM-judge configurations refused, the env-ladder swap proven mechanically; ledger in [next-phases.md](next-phases.md)), and the hardware entry prepared (ADR-phase6-prep). Any verdict restated here is a dated summary for context; the [README status table](../README.md#status) is canonical and wins on conflict (issue #142). This report states the research object,
<!-- status-snapshot:2026-09-14 canonical:../README.md#status -->
**Technical framing, August 2026; snapshot refreshed 2026-09-14, commit `fa339ee`** (no new measured result since 2026-08-28; the pre-registration program and ADR-66's pilot-first order are the delta, summarized in the README). Status snapshot: 2026-08-28, commit `93de5e0`; design-doc Phases 2 and 3 closed, the model-tier agenda in §here EXECUTED as Phase 5 (closed 2026-08-27 at measured end-states — VLA competence/latency separated by the lockstep-eval condition, five VLM-judge configurations refused, the env-ladder swap proven mechanically; ledger in [next-phases.md](next-phases.md)), and the hardware entry prepared (ADR-phase6-prep). Any verdict restated here is a dated summary for context; the [README status table](../README.md#status) is canonical and wins on conflict (issue #142). This report states the research object,

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[P1] Preserve the post-August measurements in this refreshed snapshot

This says there was "no new measured result since 2026-08-28", but analysis/m3/v2/findings.md is explicitly a measured M3 v2 campaign committed on 2026-08-31 (f002028), and this PR publishes its Spearman 0.746 result in both the README and lab briefing. The new overview is therefore internally contradictory and drops a measurement from the stated delta. Please use the narrower "no new measured hypothesis or ablation result" wording used by the README, or name M3 v2 as the exception.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in #593: the snapshot now distinguishes H/A-series results and explicitly names the post-2026-08-28 M3 v2 measurement.

Comment thread docs/lab-briefing-2026-09.md Outdated
| M3 environment ladder, v2 | Spearman 0.746 over 16 graphs × 8 seeds | unattested, self-authored population |

Three observations a lab will care about. Zero wrong-medicine deliveries have
been observed across every campaign, and the repository refuses to call that

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[P1] Keep the wrong-object summary within the catalogued evidence

The table above correctly says this is zero in retained denominators, but "across every campaign" turns it into the project-wide assertion that docs/claim-evidence.yaml explicitly says is not supported: the project-wide session denominator is not represented by one independently audited raw table. For CLM-5 consistency, please use the catalog wording (retained development summaries report zero events; prevention is unproven) instead of claiming complete campaign coverage.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in #593: the briefing now limits the statement to retained development summaries and states that no independently audited project-wide table exists.

Comment thread docs/lab-briefing-2026-09.md Outdated
## 4. How the project is run, and why it matters for reproducibility

- Specs carry numbered MUSTs; every MUST needs a test that cites its ID, and
CI fails otherwise (`tools/trace_check.py`).

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[P2] Account for explicit traceability waivers

This says CI fails whenever a MUST lacks a citing test, but tools/trace_check.py intentionally honors tools/trace_waivers.toml, and the checker at this head passes with 133 waived MUST IDs. The added glossary repeats the same categorical statement. Please say that every implemented MUST needs a citing test while unimplemented proposed requirements may carry explicit reviewed waivers; otherwise this public briefing overstates current mechanical coverage.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in #593: the briefing and glossary now describe explicit reviewable waivers and the stricter behavior of strict gates.

Comment thread docs/AISLE-technical-report.md Outdated
Forward-looking sections are labelled as such and describe committed design
direction, not shipped capability.*
direction, not shipped capability. The measured record in §9 is unchanged
since this snapshot; what changed afterwards is the pre-registration program

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[P1] Do not describe the 2026-08-16 snapshot as the unchanged measured record

The sentence says the measured record is unchanged since the 2026-08-16 snapshot and then names only the pre-registration work as the later delta. The canonical README records later measurements, including H6 on 2026-08-26, the Phase-5 results through 2026-08-27, and M3 v2 on 2026-08-31. If section 9 itself is intentionally frozen, please call it a stale historical section and direct readers to the README; otherwise the refreshed preamble incorrectly implies that those measurements never happened.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in #593: section 9 is now explicitly labeled as the historical 2026-08-16 snapshot, with H6, Phase 5, and M3 v2 directed to the canonical README.

@heyong4725 heyong4725 left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Codex cross-review: four actionable documentation-integrity findings posted inline (three P1, one P2). The implementation/checker surface is otherwise clean: both hosted unit jobs pass; ruff format/check, claim-evidence check, docs inventory, trace check, and diff check pass in an isolated worktree. The findings concern the omitted post-snapshot measurements, project-wide wrong-object wording beyond the weakened catalog row, and categorical test-coverage wording that omits trace waivers.

@heyong4725

Copy link
Copy Markdown
Contributor Author

P1 — Keep the PR summary aligned with the corrected evidence wording

The opening summary now correctly says there is no new H-series hypothesis or A-series ablation result, but the same sentence still concludes that the measured record stays at 2026-08-28 “because nothing has been measured since.” That remains false: M3 v2 is an unattested development measurement committed on 2026-08-31 (analysis/m3/v2/findings.md, Spearman 0.746), and this PR explicitly adds it to the status surfaces. Please narrow the second clause too—for example, say that the H/A result table remains dated 2026-08-28 while later development measurements are listed separately.

I re-reviewed head e1b9ffa: the four prior file-level findings are fixed, the rest of the final diff is consistent with CLM-5/CLM-8, git diff --check is clean, and both hosted unit jobs pass.

@heyong4725
heyong4725 merged commit d46ea57 into main Sep 14, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant