Skip to content

docs: Phase 0 gate scenario matrix and pass thresholds (LUM-552) - #20

Merged
FrekiManagarm merged 1 commit into
mainfrom
docs/lum-552-phase-0-gate
Nov 5, 2026
Merged

FrekiManagarm merged 1 commit into
mainfrom
docs/lum-552-phase-0-gate

Conversation

@FrekiManagarm

@FrekiManagarm FrekiManagarm commented Nov 3, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Adds docs/phase-0-gate.md for LUM-552: the scenarios, measures and numbered pass thresholds that decide whether the network half of Phase 0 is passed. They are written before the first run of the campaign, so the thresholds cannot drift towards the results.

  • 6 network profiles, 12 gate scenarios (~2 h) and a 4-scenario smoke run (~20 min);
  • 8 blocking thresholds, each with a one-line justification, plus measures that are recorded but do not block;
  • an execution protocol and an explicit list of what the gate does not cover.

Origin and revisions

The document was written in the former monorepo on 2026-09-22 (FrekiManagarm/lumyx#13). That PR was closed without merging when the repo was split. It is ported here with the revisions below, each dated in §7 of the document:

  • Audio thresholds are now read per stream. A stream is one publisher's audio as received by one subscriber. It is healthy when neither end is degraded.
  • Why: the SFU cannot repair audio, because str0m only negotiates NACK for video. Concealment on a degraded stream therefore measures the network and Opus FEC, not the SFU.
  • B1 is split:
    • B1a: < 3 % concealment on healthy streams.
    • B1b: the SFU adds no audio loss on any stream.
  • B2 and B3 now apply to healthy streams only. The original B3 counted audio from the degraded publisher, which would have failed S5 regardless of the SFU.
  • New prerequisite: export the SFU's drop counters (LUM-709). B1b cannot be measured without them.
  • Deployment target is OVH Cloud, and document paths are this repo's.

Test plan

  • Documentation only, no code change

Ported from the monorepo (7eb9920, never merged), still before any run
of the campaign, with these revisions:

- audio thresholds are read per stream; a stream is healthy when
  neither its publisher nor its subscriber is degraded
- B1 split: B1a < 3% concealment on healthy streams; B1b the SFU adds
  no audio loss on any stream. The SFU cannot repair audio (NACK is
  video only in str0m), so concealment on degraded streams measures the
  network and Opus FEC, and becomes a noted measure
- B2 and B3 restricted to healthy streams for the same reason
- new prerequisite: export the SFU drop counters, without which B1b is
  not measurable
- deployment target is OVH Cloud; document paths are this repo's
@FrekiManagarm
FrekiManagarm force-pushed the docs/lum-552-phase-0-gate branch from e6921af to 519e566 Compare November 3, 2026 23:48
@FrekiManagarm
FrekiManagarm merged commit 58c98f4 into main Nov 5, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant