Python 3.12.13, massive update of python modules by smuzaffar · Pull Request #10718 · cms-sw/cmsdist

smuzaffar · 2026-07-09T13:30:40Z

Python 3.12.13 along with massive update for python modules

xz 5.8.3 (which rebuilds python3 so we propose to update python version + python modules)
pip 26.1.2
setuptools 83.0.0

As this rebuild nearly all the externals (due to rebuild of python3) so I also propose to update the build configuration of externals to use CMAKE_BUILD_TYPE=%{cmake_build_type} which will allow us to configure and build a package in debug mode using cmsBuild --define cms_debug_packages=pkg1,pkg2

cmsbuild · 2026-07-09T13:31:04Z

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_20_1_X/master.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2026-07-09T13:31:05Z

cms-bot internal usage

smuzaffar · 2026-07-09T13:32:06Z

please test

smuzaffar · 2026-07-09T14:19:35Z

please test

cmsbuild · 2026-07-09T14:19:40Z

Pull request #10718 was updated.

cmsbuild · 2026-07-09T21:58:45Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a95fd1/54645/summary.html
COMMIT: 9bd62e7
CMSSW: CMSSW_20_1_X_2026-07-09-1100/el9_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10718/54645/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation error when building:

rm -rf /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/pkgtools-pkg-src-move2git /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/cmsdist-tmp; mkdir -p /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/cmsdist-tmp; CMSBUILD_PACKAGE=py3-cryptography;  export _CMSBUILD_BUILD_ENV_=1; export TMPDIR=/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/cmsdist-tmp;  source /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc13/rpm-env.sh; source /data/cmsbld/jenkins/workspace/ib-run-pr-tests/pkgtools/build-system-env.sh 16;  rpmbuild  --noclean --buildroot /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/3abea73aac4048d3e5e6e8d664809211 -bp --define '_smp_build_nthreads 16' --define '_topdir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir' --define "compiling_processes 16"  --define '_builddir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211' --define "cmsdist_directory /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cmsdist" --define "compilerv 1340" --define "cmscompilerv 13" --define "cmsos el9_amd64" --define "__bootstrap ~bootstrap" --define "almalinux_ver 9" --define "almalinux 9" --define "centos_ver 9" --define "centos 9" --define "rhel 9" --define "dist %{!?distprefix0:%{?distprefix}}%{expand:%{lua:for i=0,9999 do print("%{?distprefix" .. i .."}") end}}.el9%{?with_bootstrap:~bootstrap}" --define "el9 1" --define "dist_vendor         AlmaLinux OS Foundation" --define "dist_name           AlmaLinux" --define "dist_home_url       https://almalinux.org/" --define "dist_bug_report_url https://bugs.almalinux.org/" --define "package_vectorization x86-64-v2" --define "cmsswdata_version_link 1" --define "archfirst yes" --define "cmsBuild_bootstrap 1"   /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/SPECS/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/spec >>/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/py3-cryptography/49.0.0-3abea73aac4048d3e5e6e8d664809211/log 2>&1
Checking package dependencies: external+py3-uv-build+0.11.28-1a35419cece5f4de86902a3019fcdf29
Done checking package dependencies: external+py3-uv-build+0.11.28-1a35419cece5f4de86902a3019fcdf29
Checking local path dependency for rpm package external+py3-uv-build+0.11.28-1a35419cece5f4de86902a3019fcdf29 just build.
RPM installation stderr py3-uv-build:
error: Failed dependencies:
	libbz2.so.1()(64bit) is needed by external+py3-uv-build+0.11.28-1a35419cece5f4de86902a3019fcdf29-1-1.x86_64

Failed to install RPM for py3-uv-build
install-external+py3-uv-build+0.11.28-1a35419cece5f4de86902a3019fcdf29 failed.
Traceback (most recent call last):

cmsbuild · 2026-07-10T09:09:34Z

Pull request #10718 was updated.

smuzaffar · 2026-07-10T09:09:37Z

please test

smuzaffar · 2026-07-10T09:26:08Z

please test

cmsbuild · 2026-07-10T09:26:15Z

Pull request #10718 was updated.

smuzaffar · 2026-07-10T11:20:08Z

please test

cmsbuild · 2026-07-10T11:20:16Z

Pull request #10718 was updated.

cmsbuild · 2026-07-10T15:10:08Z

Pull request #10718 was updated.

smuzaffar · 2026-07-10T15:11:46Z

please test

smuzaffar · 2026-07-15T09:39:25Z

please test

cmsbuild · 2026-07-15T09:39:43Z

Pull request #10718 was updated.

smuzaffar · 2026-07-15T15:38:56Z

please test

cmsbuild · 2026-07-15T15:39:06Z

Pull request #10718 was updated.

smuzaffar · 2026-07-15T20:42:28Z

please test

cmsbuild · 2026-07-15T20:42:39Z

Pull request #10718 was updated.

smuzaffar · 2026-07-15T20:42:44Z

please test for el8_amd64_gcc13

cmsbuild · 2026-07-16T03:43:15Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a95fd1/54779/summary.html
COMMIT: 99cce69
CMSSW: CMSSW_20_1_X_2026-07-15-1100/el9_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10718/54779/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation error when building:

Done installation via rpm for hipsolver
Done external+hipsolver+7.2.4-23c00f8b07b254bde08b9fd8ccdfdeee
install-external+hipsolver+7.2.4-23c00f8b07b254bde08b9fd8ccdfdeee done
build-prep-external+rocm-rocprofiler-sdk+7.2.4-18e1ff3c5ec26ba55b2bbdf5036a70f6 failed.
Failed to build rocm-rocprofiler-sdk. Log file in /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/rocm-rocprofiler-sdk/7.2.4-18e1ff3c5ec26ba55b2bbdf5036a70f6/log. Final lines of the log file:
error: Invalid patch number p1: %patch -P 0 p1


Building ucx_x86-64-v2(build). Log can be found in /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/ucx_x86-64-v2/1.21.0-a6ba31c91a9fef6c3fab34d72028515d/log.
CMSBUILD_PACKAGE=ucx_x86-64-v2;  export _CMSBUILD_BUILD_ENV_=1; export TMPDIR=/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/ucx_x86-64-v2/1.21.0-a6ba31c91a9fef6c3fab34d72028515d/cmsdist-tmp;  source /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc13/rpm-env.sh; source /data/cmsbld/jenkins/workspace/ib-run-pr-tests/pkgtools/build-system-env.sh 16;  rpmbuild  --noclean --buildroot /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/a6ba31c91a9fef6c3fab34d72028515d -bc --short-circuit --define '_smp_build_nthreads 16' --define '_topdir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir' --define "compiling_processes 16"  --define '_builddir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/ucx_x86-64-v2/1.21.0-a6ba31c91a9fef6c3fab34d72028515d' --define "cmsdist_directory /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cmsdist" --define "compilerv 1340" --define "cmscompilerv 13" --define "cmsos el9_amd64" --define "__bootstrap ~bootstrap" --define "almalinux_ver 9" --define "almalinux 9" --define "centos_ver 9" --define "centos 9" --define "rhel 9" --define "dist %{!?distprefix0:%{?distprefix}}%{expand:%{lua:for i=0,9999 do print("%{?distprefix" .. i .."}") end}}.el9%{?with_bootstrap:~bootstrap}" --define "el9 1" --define "dist_vendor         AlmaLinux OS Foundation" --define "dist_name           AlmaLinux" --define "dist_home_url       https://almalinux.org/" --define "dist_bug_report_url https://bugs.almalinux.org/" --define "package_vectorization x86-64-v2" --define "cmsswdata_version_link 1" --define "archfirst yes" --define "cmsBuild_bootstrap 1"   /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/SPECS/external/ucx_x86-64-v2/1.21.0-a6ba31c91a9fef6c3fab34d72028515d/spec >>/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el9_amd64_gcc13/external/ucx_x86-64-v2/1.21.0-a6ba31c91a9fef6c3fab34d72028515d/log 2>&1
download-f37bdc66518b18a756ace7eeeadf11e7 done

smuzaffar · 2026-07-16T07:05:40Z

please test

cmsbuild · 2026-07-16T07:05:51Z

Pull request #10718 was updated.

cmsbuild · 2026-07-16T12:19:29Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a95fd1/54781/summary.html
COMMIT: 3ac9811
CMSSW: CMSSW_20_1_X_2026-07-15-2300/el9_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10718/54781/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 8 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3548294
DQMHistoTests: Total failures: 59
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3548217
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 163 edm output root files, 45 DQM output files
TriggerResults: no differences found

smuzaffar · 2026-07-16T17:09:15Z

please test for el8_amd64_gcc13

smuzaffar · 2026-07-16T19:55:13Z

+externals

cmsbuild · 2026-07-16T19:55:41Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_20_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @ftenchini, @mandrenguyen, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels Jul 9, 2026

cmsbuild added tests-started and removed tests-pending labels Jul 9, 2026

cmsbuild added tests-rejected tests-pending and removed tests-started tests-rejected labels Jul 9, 2026

cmsbuild added tests-started and removed tests-pending labels Jul 10, 2026

smuzaffar force-pushed the python3.12.13 branch from 7629223 to bf098d1 Compare July 10, 2026 15:09

cmsbuild added tests-pending and removed tests-started labels Jul 10, 2026

cmsbuild removed the tests-pending label Jul 10, 2026

smuzaffar force-pushed the python3.12.13 branch from 6de6d38 to f29388c Compare July 15, 2026 09:39

cmsbuild added tests-rejected and removed tests-started labels Jul 16, 2026

Python 3.12.13, xz 5.8.3 and update python packages

3ac9811

smuzaffar force-pushed the python3.12.13 branch from 99cce69 to 3ac9811 Compare July 16, 2026 07:05

cmsbuild added tests-started and removed tests-rejected labels Jul 16, 2026

cmsbuild added tests-approved and removed tests-started labels Jul 16, 2026

smuzaffar merged commit 0c2fead into IB/CMSSW_20_1_X/master Jul 16, 2026
10 of 13 checks passed

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Jul 16, 2026

cmsbuild mentioned this pull request Jul 17, 2026

[DO NOT MERGE]Build tensorflow 2.21.0 and run tests. #10724

Open

cmsbuild mentioned this pull request Jul 24, 2026

Update adept and g4vg due to update in VecGeom. #10742

Merged

Uh oh!

Conversation

smuzaffar commented Jul 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Jul 9, 2026

Uh oh!

cmsbuild commented Jul 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented Jul 9, 2026

Uh oh!

smuzaffar commented Jul 9, 2026

Uh oh!

cmsbuild commented Jul 9, 2026

Uh oh!

cmsbuild commented Jul 9, 2026

Failed External Build

Uh oh!

cmsbuild commented Jul 10, 2026

Uh oh!

smuzaffar commented Jul 10, 2026

Uh oh!

smuzaffar commented Jul 10, 2026

Uh oh!

cmsbuild commented Jul 10, 2026

Uh oh!

smuzaffar commented Jul 10, 2026

Uh oh!

cmsbuild commented Jul 10, 2026

Uh oh!

cmsbuild commented Jul 10, 2026

Uh oh!

smuzaffar commented Jul 10, 2026

Uh oh!

smuzaffar commented Jul 15, 2026

Uh oh!

cmsbuild commented Jul 15, 2026

Uh oh!

smuzaffar commented Jul 15, 2026

Uh oh!

cmsbuild commented Jul 15, 2026

Uh oh!

smuzaffar commented Jul 15, 2026

Uh oh!

cmsbuild commented Jul 15, 2026

Uh oh!

smuzaffar commented Jul 15, 2026

Uh oh!

cmsbuild commented Jul 16, 2026

Failed External Build

Uh oh!

smuzaffar commented Jul 16, 2026

Uh oh!

cmsbuild commented Jul 16, 2026

Uh oh!

cmsbuild commented Jul 16, 2026

Comparison Summary

Uh oh!

smuzaffar commented Jul 16, 2026

Uh oh!

smuzaffar commented Jul 16, 2026

Uh oh!

Uh oh!

cmsbuild commented Jul 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

smuzaffar commented Jul 9, 2026 •

edited

Loading

cmsbuild commented Jul 9, 2026 •

edited

Loading