Skip to content

ci: balance heavy tests across test matrix legs - #5964

Draft
jezdez wants to merge 1 commit into
ci/test-speed-hygienefrom
ci/heavy-test-marker
Draft

ci: balance heavy tests across test matrix legs#5964
jezdez wants to merge 1 commit into
ci/test-speed-hygienefrom
ci/heavy-test-marker

Conversation

@jezdez

@jezdez jezdez commented Apr 28, 2026

Copy link
Copy Markdown
Member

Description

Stacked on top of #5963.

This PR introduces an @pytest.mark.heavy marker and uses it to distribute five high-duration integration tests between the two xdist matrix legs.

The current durations/Linux.json records:

665.9s  test_api_build_grpc_issue5645
185.1s  test_conda_py_no_period
184.9s  test_sysroots_detection
126.0s  test_cross_unix_windows_mingw
124.5s  test_ignore_run_exports_from_substr

These stored call durations total about 1,286 seconds. They overlap when tests run under xdist, so they are useful for selecting expensive tests but are not a wall-time estimate.

Linux and macOS route heavy tests to the matrix leg named serial. Both matrix legs continue to run with pytest -n auto. On Windows, heavy and slow tests remain excluded, preserving the existing exclusion of test_conda_py_no_period.

The intended effect is to distribute long-running tests more evenly between concurrently scheduled CI jobs without changing their execution semantics.

Checklist - did you ...

  • Add a file to the news directory (using the template) for the next release's release notes?
  • Add / update necessary tests? — adds markers to five existing tests
  • Add / update outdated documentation? — no user-facing documentation affected

@conda-bot conda-bot added the cla-signed [bot] added once the contributor has signed the CLA label Apr 28, 2026
@github-project-automation github-project-automation Bot moved this to 🆕 New in 🔎 Review Apr 28, 2026
@codspeed-hq

codspeed-hq Bot commented Apr 28, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 5 untouched benchmarks


Comparing ci/heavy-test-marker (baa286f) with ci/test-speed-hygiene (b4f0aa7)

Open in CodSpeed

@jezdez
jezdez force-pushed the ci/heavy-test-marker branch from db3ff71 to 9b17470 Compare July 24, 2026 15:33
@jezdez jezdez changed the title ci: isolate heavy tests (>2 min) into the serial leg ci: balance heavy tests across test matrix legs Jul 24, 2026
@jezdez
jezdez force-pushed the ci/heavy-test-marker branch from 9b17470 to db56bbb Compare July 24, 2026 16:17
@jezdez
jezdez force-pushed the ci/heavy-test-marker branch from db56bbb to baa286f Compare July 24, 2026 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed [bot] added once the contributor has signed the CLA

Projects

Status: 🆕 New

Development

Successfully merging this pull request may close these issues.

2 participants