Skip to content

tests: add testing for Python 3.15 - #17948

Draft
parthea wants to merge 20 commits into
mainfrom
add-testing-315
Draft

tests: add testing for Python 3.15#17948
parthea wants to merge 20 commits into
mainfrom
add-testing-315

Conversation

@parthea

@parthea parthea commented Jul 30, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

[WIP] This PR depends on #17438

gemini-code-assist[bot]
gemini-code-assist Bot reviewed Jul 30, 2026
View reviewed changes

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces Python 3.15 support across multiple packages, adds a batching script (ci/get_batches.py) for test execution, and updates test runners to support Python 3.15. Feedback on the changes includes correcting the handling of preview-packages in ci/run_conditional_tests.sh, moving the shebang to the first line in ci/get_batches.py, removing duplicate skip blocks in packages/google-cloud-bigtable/noxfile.py, and correcting a package constraint name in packages/google-cloud-spanner-dbapi-driver.

Comment thread ci/run_conditional_tests.sh Outdated
Comment thread ci/get_batches.py
Comment thread packages/google-cloud-bigtable/noxfile.py Outdated
Comment thread packages/google-cloud-spanner-dbapi-driver/testing/constraints-3.15.txt
parthea added 10 commits July 30, 2026 17:33
@parthea
git checkout origin/main .github/workflows/unittest.yml
c5e3980
@parthea
git checkout origin/main ci/run_conditional_tests.sh
46fdb3d
@parthea
Squashed commit of the following:
5f5d63b 
commit 73ed7ae
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jul 30 09:58:32 2026 -0700

    experiemting with inner-shard parallel runs

commit 4822342
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jul 30 09:58:16 2026 -0700

    dded uv seed to allow pip in venvs

commit f40572c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jul 30 09:46:00 2026 -0700

    use uv

commit 7c29040
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jul 30 09:45:30 2026 -0700

    obey test all flag in lint checks

commit b5639c6
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 23:37:09 2026 -0700

    fixing mypy check

commit 8816f61
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 23:33:15 2026 -0700

    revered back to simpler sharding algorithm

commit c16385f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 22:41:43 2026 -0700

    trying different shard algorithm

commit 9bd04b8
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 21:23:34 2026 -0700

    make sure up to MAX_SHARDS are used

commit 8f12c4e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 21:17:24 2026 -0700

    improved sharding algorithnm

commit 4e6f3fc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 20:39:24 2026 -0700

    group preview packages with main package in shards

commit 36c55dc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 19:07:53 2026 -0700

    adjust how package names are displayed

commit 796eedb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 18:53:22 2026 -0700

    improve how multiple package directories are handled

commit 09d705a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 16:38:34 2026 -0700

    improved git diff logic for preview packages

commit 4f3b012
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 16:29:59 2026 -0700

    show preview in shard name for preview packages

commit f8da556
Merge: e394b88 2d1372b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 29 15:52:20 2026 -0700

    Merge branch 'main' into ci_sharding

commit e394b88
Merge: eefea36 d328e3b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 28 10:35:23 2026 -0700

    Merge branch 'main' into ci_sharding

commit eefea36
Merge: 7ca0171 53b48ae
Author: Daniel Sanche <sanche@google.com>
Date:   Mon Jul 27 09:27:26 2026 -0700

    Merge branch 'main' into ci_sharding

commit 7ca0171
Merge: 4e8892c 4f21b8b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jul 24 16:28:08 2026 -0700

    Merge branch 'main' into ci_sharding

commit 4e8892c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 22 12:22:11 2026 -0700

    fixed truncation issues

commit 4382fcc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Wed Jul 22 12:15:23 2026 -0700

    added comment

commit 04fb332
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jul 17 14:15:40 2026 -0700

    changed sqlalchemy-spanner coverage value

commit a05d1fb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jul 17 11:54:34 2026 -0700

    update spanner coveragerc

commit fb71278
Merge: eaf75e9 95da740
Author: Daniel Sanche <sanche@google.com>
Date:   Fri Jul 17 11:53:23 2026 -0700

    Merge branch 'main' into ci_sharding

commit eaf75e9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 13:22:17 2026 -0700

    print only count for successes

commit c70613a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 13:19:30 2026 -0700

    moved script out of yaml

commit f1eb3a4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 13:14:33 2026 -0700

    added comments to sharding script

commit cf3de20
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 13:10:55 2026 -0700

    added back subdirs

commit d04104d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 13:08:17 2026 -0700

    cleaned up conditional tests

commit e35ea34
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 12:57:16 2026 -0700

    removed duplication

commit 010e1ad
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 12:53:49 2026 -0700

    remove empty files

commit a4566cf
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 12:53:30 2026 -0700

    use all runtimes in coverage

commit 60a3e74
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 12:01:11 2026 -0700

    fixed coverage condition

commit e1bedf1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 11:57:13 2026 -0700

    avoid going over max_shards

commit 6c0566f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 10:23:30 2026 -0700

    use 3.10 as lower bound

commit 5bfe2d1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 10:19:58 2026 -0700

    only upload coverage for first and last supported version

commit cd33370
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 10:00:28 2026 -0700

    undo fast-path optimization

commit fa06713
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:43:56 2026 -0700

    added fast path for coverage check

commit 45b5e68
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:26:09 2026 -0700

    define package weights in yaml

commit e453d2c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:21:08 2026 -0700

    added test files

commit e611fe7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:17:22 2026 -0700

    made max shards configurable

commit da2f41e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:15:52 2026 -0700

    use RAM disk for coverage results

commit 073dc07
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Tue Jul 7 09:11:02 2026 -0700

    Revert "combine coverage in shards"

    This reverts commit b9f750d.

commit b9f750d
Author: Daniel Sanche <sanche@google.com>
Date:   Mon Jul 6 22:02:13 2026 -0700

    combine coverage in shards

    Updated the unittest workflow to include coverage installation and combine coverage results for better reporting.

commit b4f9d9d
Author: Daniel Sanche <sanche@google.com>
Date:   Mon Jul 6 21:32:36 2026 -0700

    updated find call

commit 15421a7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 19:05:41 2026 -0700

    removed empty file

commit b20bb1a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:58:32 2026 -0700

    enable test against ces

commit deaabe7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:50:49 2026 -0700

    fixing bug in coverage search

commit 5cb0e26
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:46:55 2026 -0700

    added pip cache

commit bdc977a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:32:21 2026 -0700

    end early if fail_under = 0

commit 8ea10ec
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:18:33 2026 -0700

    change MAX_JOBS

commit b4733da
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:18:25 2026 -0700

    fix coverage files

commit 964e142
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 18:16:36 2026 -0700

    optimized coverage step

commit 80f0061
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 16:53:58 2026 -0700

    avoid combining all coverage files

commit e4495b8
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 16:45:48 2026 -0700

    fixed typo

commit f14d489
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 15:18:01 2026 -0700

    pack shards alphabetically

commit 2e9bafc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 15:11:57 2026 -0700

    added additional weights

commit 7ccca59
Merge: 8c4d2dd 6a49390
Author: Daniel Sanche <sanche@google.com>
Date:   Mon Jul 6 14:26:07 2026 -0700

    Merge branch 'main' into ci_sharding

commit 8c4d2dd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 14:25:39 2026 -0700

    resolve merge conflict

commit 92626bd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 14:23:17 2026 -0700

    parallelize final cover check

commit a1fab95
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 14:19:16 2026 -0700

    use pacakge weights instead of isolation

commit 89e5499
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 13:16:30 2026 -0700

    changed shard names

commit 40d31e3
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 13:12:41 2026 -0700

    isolated shards should be included in max_shard count

commit ee7cabc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 12:35:03 2026 -0700

    isolate specific packages

commit c99a693
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 12:27:23 2026 -0700

    increased shard count

commit 6123e7a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 12:22:47 2026 -0700

    revered unrelated changes

commit fb90860
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 11:48:19 2026 -0700

    don't trigger on label changes

commit 8fb68d3
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 11:37:32 2026 -0700

    re-run when label added

commit 6c1be8b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Mon Jul 6 11:30:23 2026 -0700

    added github tag to test all packages

commit e34b654
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 18 17:03:08 2026 -0700

    reverted systen test changes

commit 72503de
Merge: 7b565a4 690c15d
Author: Daniel Sanche <sanche@google.com>
Date:   Thu Jun 18 16:59:37 2026 -0700

    Merge branch 'main' into ci_sharding

commit 7b565a4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 19:09:44 2026 -0700

    added no-fail .coveragerc to sqlalchemy-spanner

commit ae05642
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 19:09:16 2026 -0700

    added summary to cover step

commit 83ca04a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 18:10:46 2026 -0700

    added known-bad package

commit 886d6d9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 18:07:20 2026 -0700

    unit tests fail if initialize fails

commit cf554ca
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 18:02:52 2026 -0700

    add label to number in shard

commit 9c80a51
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 18:00:18 2026 -0700

    rename tests

commit acdfb18
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:49:45 2026 -0700

    iterating on shard logic

commit c3cf49e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:43:10 2026 -0700

    change shard logic

commit b36b559
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:35:40 2026 -0700

    fixed typo

commit a5cc497
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:29:36 2026 -0700

    activated 11th package (enable sharding)

commit 980d8eb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:10:15 2026 -0700

    change default for coverage percent

commit 3633089
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 17:07:00 2026 -0700

    10 packages total

commit 7bb323c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 16:43:46 2026 -0700

    activated more packages

commit b00967f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 15:17:58 2026 -0700

    loosen firestore coverage requirement

commit cf1a1f1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 15:12:07 2026 -0700

    use individual coverage checks

commit 71f444a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 13:55:50 2026 -0700

    fail fast

commit a0f5c9a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 13:50:18 2026 -0700

    allow hidden files for cover

commit 1cd8c1f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 13:28:15 2026 -0700

    attempt fix for cover

commit c49b06d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 13:17:10 2026 -0700

    attempt cover fix

commit ff1274f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 12:37:01 2026 -0700

    remove global run on ci/ change

commit 32968a9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 12:33:23 2026 -0700

    add shard descriptions

commit 8b825d5
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 12:20:49 2026 -0700

    updated lint and mypy logic

commit fd5792d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 12:20:31 2026 -0700

    removed many SHARD_TEST files

commit e6167bd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 11:43:25 2026 -0700

    system tests print all logs in main build log

commit 6e3531d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 11:25:24 2026 -0700

    removed sqlalchemy-spanner from touched packages

commit 46d1583
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 11:19:01 2026 -0700

    fixed lint/mypy runs

commit de74a68
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 10:42:56 2026 -0700

    update sharding logic

commit d8dd522
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 10:38:34 2026 -0700

    update system tests to show logs for each target

commit 49cac0f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 10:35:12 2026 -0700

    attempt fix for lint

commit 15916df
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Fri Jun 12 09:26:18 2026 -0700

    split out system test logs

commit af4d10c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 21:33:04 2026 -0700

    fix system tests

commit a450254
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 19:01:06 2026 -0700

    fix coverage

commit 74f1ef7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:36:13 2026 -0700

    fixed tests

commit 73ab091
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:31:58 2026 -0700

    changed shard params

commit 3c8d057
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:29:10 2026 -0700

    added unit-complete to gather all shards

commit 02c7653
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:25:15 2026 -0700

    added sharding test file

commit 9ad0f0c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:24:57 2026 -0700

    added changes to many packages for testing

commit a7502d4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:21:14 2026 -0700

    run system tests concurrently

commit 01d4753
Author: Daniel Sanche <d.sanche14@gmail.com>
Date:   Thu Jun 11 17:21:04 2026 -0700

    added unit test sharding
@parthea
restore 3.15
b6cbd62
@parthea
restore 3.15
2f8483a
@parthea
address zizmor
ea8c9a6
@parthea
address feedback
6eb430f
@parthea
temporarily speed up feedback
f394a59
@parthea
temporarily speed up feedback
527dcae
@parthea
revert
6f01ed4
@parthea parthea closed this Jul 30, 2026
@parthea parthea reopened this Jul 30, 2026
@parthea

parthea commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

Strategy for job 'unit' produced 264 configurations which exceeds the maximum of 256 configurations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer
@gemini-code-assist gemini-code-assist[bot] gemini-code-assist[bot] left review comments
Reviewers whose approvals may not affect merge requirements

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

unit_test:all_packages

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@parthea