Skip to content

The cases visual baseline was a screenshot of the dashboard - #1685

Merged
rubenvdlinde merged 1 commit into
developmentfrom
chore/store-visual-baseline
Sep 2, 2026
Merged

The cases visual baseline was a screenshot of the dashboard#1685
rubenvdlinde merged 1 commit into
developmentfrom
chore/store-visual-baseline

Conversation

@rubenvdlinde

Copy link
Copy Markdown
Contributor

Two loose ends from the label fix in #1677.

The cases baseline was the dashboard, and here is the proof

cases-visual-linux.png and dashboard-visual-linux.png were byte-identical — same md5, 32e5617a73a834cf6c1a6fb7c4abc24b. Not an inference from reading the code: the artefacts themselves were the same image.

shootByNav resolves its label behind if (await link.isVisible()), so when #1646 renamed the entry the click silently never happened and the screenshot was taken wherever the app had landed. That is the Dashboard, filed as cases.png, for as long as that rename has been in.

#1677 fixed the label. That made the test correct and left the baseline wrong — the next visual run would have diffed the real cases page against a dashboard image and failed, reading as a regression in the page rather than a stale artefact. Regenerated; it now differs from the dashboard, which is the assertion that was never actually available before.

The store baseline was missing

gate-26 accepted the visual test added in #1677, but every other visual test carries a committed baseline and this one did not. The first person to run the visual project would have hit a missing snapshot.

No CI risk

The visual project is deliberately excluded from CI: tests/e2e/playwright.config.ts is the config the shared workflow resolves, chosen precisely so a CI Linux runner never tries to byte-match a dev-container PNG. Both images were shot against a dedicated instance and are for local runs.

🤖 Generated with Claude Code

… none

Two loose ends from the label fix that shipped in #1677.

THE CASES BASELINE WAS A SCREENSHOT OF THE DASHBOARD, and now there is proof
rather than an inference: `cases-visual-linux.png` and
`dashboard-visual-linux.png` were byte-identical, same md5. `shootByNav`
resolves its label behind `if (isVisible)`, so when dossiq#1646 renamed the
entry the click silently never happened and the shot was taken wherever the
app had landed — the Dashboard, under the name cases.png, for as long as that
rename has been in.

#1677 fixed the LABEL, which made the test correct and left the baseline
wrong: the next visual run would have compared the real cases page against a
dashboard image and failed, looking like a regression in the page rather than
a stale artefact. Regenerated, and it now differs from the dashboard, which is
the assertion that was never available before.

The store baseline is new. gate-26 accepted the visual TEST added in #1677,
but every other visual test carries a committed baseline and this one did not,
so the first person to run the visual project would have hit a missing
snapshot.

Both shot against a dedicated instance. The `visual` project is deliberately
excluded from CI — tests/e2e/playwright.config.ts is the config the workflow
resolves, precisely so a CI Linux runner never tries to byte-match a
dev-container PNG — so these are for local runs and carry no CI risk.
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Quality Report — ConductionNL/dossiq @ 89b7ad3

Check PHP Vue Security License Tests
lint
phpcs
phpmd
psalm
phpstan
phpmetrics
eslint
stylelint
build
check-manifest
check-vue3-compile
test-l10n
format
check-schema-l10n
check-l10n-js
composer ✅ 106/106
npm ✅ 540/540
app:check-code ⏭️
info.xml
REUSE
PHPUnit
Newman ⏭️
Playwright ⏭️ deferred — runs on the promotion into beta/main, not on a pull request into development
Hydra gates

Quality workflow — 2026-09-02 19:08 UTC

Download the full PDF report from the workflow artifacts.

@rubenvdlinde
rubenvdlinde merged commit cbe429f into development Sep 2, 2026
49 checks passed
@rubenvdlinde
rubenvdlinde deleted the chore/store-visual-baseline branch September 2, 2026 19:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant