docs: launch-rehearsal receipt — 6-box EU ring, 7 bugs, engine proven on sm_120#134
Merged
Conversation
The engine computes mean_accept, toks_per_traversal (g), tok_s, prefill_s, and the per-stage transport/compute split, then DROPPED them — SHARD_JOB_DONE carried only the text + token count, so the daemon serve path was unmeasurable (no way to see tok/s, acceptance, or where the time goes). Emit an additive SHARD_JOB_METRICS line with whatever perf fields the run produced; consumers that don't know it ignore it (the daemon logs unknown contract lines). Found by the rehearsal-measurement design — turns a black-box serve into an explainable one.
…proven on sm_120 Real-hardware rehearsal (~$8, 6-box EU ring serving MiniMax-M2.5 via the stranger daemon path). Found 7 launch issues (4 pre-spend by a design panel, 3 on real hardware incl. TWO fatal manifest byte-integrity bugs that would have failed EVERY launch pull). Proven green on real 5090s: self-provision, sm_120 cutlass engine load, verified 35GB pull, peer seeding, and ring formation across 6 EU boxes (the -announce fix). NOT achieved: end-to-end serve tokens — the ring formed but a cold-cohort re-form storm starved the serve (0 tokens), so no tok/s numbers yet; that's the focused follow-up.
leyten
added a commit
that referenced
this pull request
Jul 22, 2026
…120 (#134) * feat(coordinate): surface serve perf metrics (tok/s, g, transport split) The engine computes mean_accept, toks_per_traversal (g), tok_s, prefill_s, and the per-stage transport/compute split, then DROPPED them — SHARD_JOB_DONE carried only the text + token count, so the daemon serve path was unmeasurable (no way to see tok/s, acceptance, or where the time goes). Emit an additive SHARD_JOB_METRICS line with whatever perf fields the run produced; consumers that don't know it ignore it (the daemon logs unknown contract lines). Found by the rehearsal-measurement design — turns a black-box serve into an explainable one. * docs: launch-rehearsal receipt — 6-box EU ring, 7 bugs found, engine proven on sm_120 Real-hardware rehearsal (~$8, 6-box EU ring serving MiniMax-M2.5 via the stranger daemon path). Found 7 launch issues (4 pre-spend by a design panel, 3 on real hardware incl. TWO fatal manifest byte-integrity bugs that would have failed EVERY launch pull). Proven green on real 5090s: self-provision, sm_120 cutlass engine load, verified 35GB pull, peer seeding, and ring formation across 6 EU boxes (the -announce fix). NOT achieved: end-to-end serve tokens — the ring formed but a cold-cohort re-form storm starved the serve (0 tokens), so no tok/s numbers yet; that's the focused follow-up.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Real-hardware rehearsal (~$8). 7 launch issues found (2 fatal manifest byte-integrity bugs that would fail every launch pull). Proven on real 5090s: self-provision, sm_120 cutlass engine load, 35GB verified pull, peer seeding, 6-box EU ring formation. NOT achieved: serve tokens (re-form storm starved it) — focused follow-up. Receipt in docs/receipts/.