Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 0 additions & 43 deletions benchmarks/cases/java-semantic-packs-v0.9.1.yaml

This file was deleted.

43 changes: 0 additions & 43 deletions benchmarks/cases/scala-semantic-packs-v0.9.1.yaml

This file was deleted.

4 changes: 2 additions & 2 deletions docs/src/content/docs/results/evidence.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ Each profile remains visible before any aggregate. The numbers here are selected

## Reviewed legacy boundaries

The immutable promotion is `legacy-promotion-v1-balanced-core`. Its balanced core is **110 cases**, with **42 overflow** candidates and **6 controls** kept outside the correctness denominator. The source-only legacy inventory contains 158 cases; the remaining development corpus also contains 2 semantic-pack cases that were never part of that inventory.
The immutable promotion is `legacy-promotion-v1-balanced-core`. Its balanced core is **110 cases**, with **42 overflow** candidates and **6 controls** kept outside the correctness denominator. The source-only legacy inventory contains 158 cases.

| Language | Balanced-core cases |
| --- | ---: |
Expand Down Expand Up @@ -60,7 +60,7 @@ The entries below are derived only from checksum-verified release bundles. The g

## Remaining development evidence

The checked-in development corpus contains **160 cases**. The reviewed legacy core accounts for 110; the 50 cases outside that core comprise 42 frozen overflow candidates, 6 unsupported/not-planned controls, and 2 semantic-pack cases. This remainder is retained for regression and diagnosis; it is not silently added to v1, v2, or the legacy denominator.
The checked-in development corpus contains **158 cases**. The reviewed legacy core accounts for 110; the 48 cases outside that core comprise 42 frozen overflow candidates and 6 unsupported/not-planned controls. This remainder is retained for regression and diagnosis; it is not silently added to v1, v2, or the legacy denominator.

## Publication safeguards

Expand Down
6 changes: 3 additions & 3 deletions docs/src/data/evidence.json
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
{
"development": {
"balancedCoreCases": 110,
"caseCount": 160,
"caseCount": 158,
"controlCases": 6,
"legacyInventoryCases": 158,
"overflowCases": 42,
"remainingCases": 50,
"semanticPackCases": 2
"remainingCases": 48,
"semanticPackCases": 0
},
"generatedBy": "scripts/generate-docs-evidence.py",
"guardrails": [
Expand Down
5 changes: 0 additions & 5 deletions fixtures/java/semantic-packs/src/Main.java

This file was deleted.

5 changes: 0 additions & 5 deletions fixtures/scala/semantic-packs/src/Main.scala

This file was deleted.

26 changes: 24 additions & 2 deletions scripts/generate-docs-evidence.py
Original file line number Diff line number Diff line change
Expand Up @@ -393,6 +393,28 @@ def development_case_ids() -> list[str]:
return ids


def _semantic_pack_clause(development: dict[str, Any]) -> str:
"""Mention semantic-pack cases only while the corpus carries any.

The category is empty once the published v0.9.1 packs are retired, and a
sentence that reports zero of something reads as an oversight rather than a
boundary.
"""

count = development["semanticPackCases"]
if not count:
return ""
return (
f" The remaining development corpus also contains {count} semantic-pack "
"cases that were never part of that inventory."
)


def _semantic_pack_tail(development: dict[str, Any]) -> str:
count = development["semanticPackCases"]
return f", and {count} semantic-pack cases" if count else ""


def build_legacy(bundles: dict[str, dict[str, Any]]) -> dict[str, Any]:
# The published legacy result is the authority for this slice, so the map
# describes the manifest that snapshot was frozen under, not the one the
Expand Down Expand Up @@ -564,7 +586,7 @@ def markdown(data: dict[str, Any]) -> str:
"",
"## Reviewed legacy boundaries",
"",
f"The immutable promotion is `{legacy['promotionId']}`. Its balanced core is **{legacy['caseCount']} cases**, with **{legacy['overflowCases']} overflow** candidates and **{legacy['controlCases']} controls** kept outside the correctness denominator. The source-only legacy inventory contains {legacy['inventoryCases']} cases; the remaining development corpus also contains {development['semanticPackCases']} semantic-pack cases that were never part of that inventory.",
f"The immutable promotion is `{legacy['promotionId']}`. Its balanced core is **{legacy['caseCount']} cases**, with **{legacy['overflowCases']} overflow** candidates and **{legacy['controlCases']} controls** kept outside the correctness denominator. The source-only legacy inventory contains {legacy['inventoryCases']} cases.{_semantic_pack_clause(development)}",
"",
"| Language | Balanced-core cases |",
"| --- | ---: |",
Expand Down Expand Up @@ -603,7 +625,7 @@ def markdown(data: dict[str, Any]) -> str:
"",
"## Remaining development evidence",
"",
f"The checked-in development corpus contains **{development['caseCount']} cases**. The reviewed legacy core accounts for {development['balancedCoreCases']}; the {development['remainingCases']} cases outside that core comprise {development['overflowCases']} frozen overflow candidates, {development['controlCases']} unsupported/not-planned controls, and {development['semanticPackCases']} semantic-pack cases. This remainder is retained for regression and diagnosis; it is not silently added to v1, v2, or the legacy denominator.",
f"The checked-in development corpus contains **{development['caseCount']} cases**. The reviewed legacy core accounts for {development['balancedCoreCases']}; the {development['remainingCases']} cases outside that core comprise {development['overflowCases']} frozen overflow candidates and {development['controlCases']} unsupported/not-planned controls{_semantic_pack_tail(development)}. This remainder is retained for regression and diagnosis; it is not silently added to v1, v2, or the legacy denominator.",
"",
"## Publication safeguards",
"",
Expand Down
6 changes: 3 additions & 3 deletions src/runners/bifrost.rs
Original file line number Diff line number Diff line change
Expand Up @@ -2979,9 +2979,9 @@ mod tests {
let totals =
requested_run_totals(documents.iter().map(|(_, document)| document), false, None);

assert_eq!(totals.documents, 61);
assert_eq!(totals.authored_cases, 232);
assert_eq!(totals.planned_cases, 226);
assert_eq!(totals.documents, 59);
assert_eq!(totals.authored_cases, 230);
assert_eq!(totals.planned_cases, 224);
assert_eq!(
totals.development_planned_cases + totals.evaluation_planned_cases,
totals.planned_cases
Expand Down