Bifrost v0.10.5 navigates this case correctly, so the annotation asserting it
cannot is stale.
Measured on the 110-case balanced core (see #160):
|
v0.10.1 |
v0.10.5 |
| status |
expected_failure |
improved |
| usage→declaration |
no_definition, no target |
ok → include/parity.h:45:20 |
45:20 is exactly the expectedDeclaration the case authors. The runner
reports improved precisely for this — a case that passes while annotated as
an expected failure — so the corpus is already flagging it rather than hiding
it.
What to change
Remove the expected-failure annotation from
cpp-parity-function-like-macro-expanded-call in
benchmarks/cases/cpp-lsp-parity.yaml so the case is scored as an ordinary
pass.
Care required
This is reviewed ground truth. The annotation presumably carries a reason
string recording why the case was expected to fail; retiring it should record
that Bifrost now satisfies the authored contract, with the measurement above as
the evidence, rather than silently deleting the note.
Also worth confirming the reference-container run agrees before editing — #160
was measured natively, and native reports label themselves host_specific.
Effect on the freeze
While the annotation stands, a legacy freeze reports one improved case.
That does not block publication — the gates require errors == 0 — but it
means the published result carries a stale expectation.
Bifrost v0.10.5 navigates this case correctly, so the annotation asserting it
cannot is stale.
Measured on the 110-case balanced core (see #160):
expected_failureimprovedno_definition, no targetok→include/parity.h:45:2045:20is exactly theexpectedDeclarationthe case authors. The runnerreports
improvedprecisely for this — a case that passes while annotated asan expected failure — so the corpus is already flagging it rather than hiding
it.
What to change
Remove the expected-failure annotation from
cpp-parity-function-like-macro-expanded-callinbenchmarks/cases/cpp-lsp-parity.yamlso the case is scored as an ordinarypass.
Care required
This is reviewed ground truth. The annotation presumably carries a reason
string recording why the case was expected to fail; retiring it should record
that Bifrost now satisfies the authored contract, with the measurement above as
the evidence, rather than silently deleting the note.
Also worth confirming the reference-container run agrees before editing — #160
was measured natively, and native reports label themselves
host_specific.Effect on the freeze
While the annotation stands, a legacy freeze reports one
improvedcase.That does not block publication — the gates require
errors == 0— but itmeans the published result carries a stale expectation.