Repository navigation
LEARN-02.1 WIP: hardness rubric, routing policy and evaluation design (Refs #5249) - #5250
Conversation
ca35719 to
1e20ad9
Compare
|
Independent source review PASS by The reviewer verified all three repairs: shared durable possible-send custody and native comment readback; reconstruction of the entire closed telemetry packet before effects; and the corrected attribution join with deduplication and conflicting-assignment refusal. Recounted evidence: 66 private evidence digests, 0 mismatches; SQL controls 74 lineage rows / 74 distinct assignments / 0 ambiguous invocations / 34 attributed identities, with retained aggregate-row equality. Calibration recount: 6 original Deliveries / 7 anchored PR examples / 19 recorded rounds / 4 token overlaps, plus the broader 32-Delivery cohort. The reviewer checked 20 test cases and the exact-head No edits, tests, or live effects were performed by the reviewer. Hosted required checks remain pending; this PR stays draft until they pass. Root owns merge and acceptance. No live dispatch-recording effect is authorized by this review. |
… (Refs #5249) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
9897bcd to
00e2f18
Compare
|
Independent source and final assembly review: APPROVE SOURCE, reviewer or_5245, exact Exact candidate original full semantic qualification passed locally (exit0,395.560143s) and hosted in 41445223497: Merge accepts source only and retains delivery-continues. #5249 remains open for the first genuine post-merge dispatch recording and both native comment/telemetry readbacks. No mock or retrospectively backdated assignment establishes that operational effect. |
Add LEARN-02 rubric/routing v1, a dispatch-recording tool, retrospective calibration, and a framework Atlas record. Classification freezes the owning Delivery body before dispatch, preserves unknowns and safety floors, and records the chosen runtime/model/profile and propensity. Recording prepares a digest-bound native comment and existing-schema telemetry observation; explicit live mode uses shared durable custody, native readback and no automatic uncertain-send retry. No learned routing or exploration activates itself.
Calibration uses 7 recorded PR examples from 6 original Deliveries (19 review rounds), plus 32 eligible Deliveries from the attributed-store population. Review correlation is 0.2283, or 0.0509 after one mean per Delivery; partial log-token correlation is 0.2177 across 32 observations, versus −0.8173 in the 4 anchor overlaps. Complete blocking counts and whole-Delivery costs remain Unknown. The report recommends prospective frozen observations rather than claiming policy benefit. Raw evidence remains private.
Final source is
00e2f18820c166997b943f445486a10eef9c96b1on baseb8a444ee9ae7bef535adfcb39445577bcf0feb4e, including coherent 0.114.4. Independent source and assembled-candidate review byor_5245passed. All 524 base Atlas records remain, plus the two reviewed LEARN versions; current managed manifests and prior writer-roster evidence are preserved.Validation on the exact candidate:
Ran 20 tests/OK.routine-delivery board mutate: 73/73 mutants killed;skill-quality fixture: all 60 rejection cases passed. Local exit 0 in 395.560143 seconds under enforced 1 CPU / 2 GiB / swap 0 and a 1200-second outer bound, using SDK 10.0.403 / .NET 10.0.14 / Python 3.14.8 with private ext4 outputs. Its three canonical source hashes equal the original Owner briefs carry the reviewers' standard adversarial checks; dispatch names shared-type owners #5239 qualification; no skill-quality / semantic-skill-quality times out at its 10-minute limit (≈40% of runs cancelled, incl. main) #5228 optimization was used.not-exercised/gs2089: unresolved; no operational authorization is inferred.Fixture clock/source/sandbox: synthetic snapshots use fixed 2026-01-01T00:00:00Z and example/repo#1; native/receiver IO is mocked; mutation and CLR fixtures use disposable private directories and original inputs. No credentials or raw telemetry are committed. Earlier failed/cancelled attempts remain retained and linked in the PR history; no hosted check conclusion, gate or timeout was weakened.
This merge supplies the source slice. Root will activate real recording on the next genuinely new dispatch after merge, preserving its actual input-time boundary and checking both comment and telemetry readback; existing assignments will not be backdated. Full Delivery acceptance remains open until that intended-use assertion is observed. Parent #5248 retains prospective learning, policy evaluation and broader adoption.
Refs #5249
Refs #5248
Related semantic-runtime work: #5228