Skip to content

CUDA EP as a standalone plugin package (onnxruntime-ep-cuda) — explores #196 follow-up #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
hmaarrfk wants to merge 56 commits into
base: main
Choose a base branch
from
Draft

CUDA EP as a standalone plugin package (onnxruntime-ep-cuda) — explores #196 follow-up #197

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
1047172
Use rattler-build
cbourjau Apr 22, 2026
1d99dfb
Fix lints
cbourjau Apr 23, 2026
ec8e381
Run gtests
cbourjau Apr 23, 2026
9031f6f
Skip tests when cross-compiling
cbourjau Apr 23, 2026
7d25f3b
Sleep on windows
cbourjau Apr 23, 2026
535600f
Remove redundant flags
cbourjau Apr 24, 2026
a60f19d
Debug
cbourjau Apr 24, 2026
bbd9a78
Enable contrib ops
cbourjau Apr 24, 2026
33f7e3c
Explicitly delete Python cmake cache variables
cbourjau Apr 25, 2026
002b922
Patch CMakeCache.txt directly
cbourjau Apr 25, 2026
5f23a2c
Rerender to test conda builds
cbourjau Aug 9, 2026
b14fcbb
Remove cruft from build scripts and enable tests
cbourjau Apr 26, 2026
5d42afc
Fix cuda dependencies
cbourjau Aug 9, 2026
33c0f73
Use iconv from glibc
cbourjau Apr 27, 2026
b7b52a3
Try to fix cuda dependencies
cbourjau Apr 27, 2026
b9bb500
Pass cuda version to build script
cbourjau Apr 27, 2026
19e5284
Set CUDA_HOME and use c++20
cbourjau Apr 27, 2026
3a83bea
Remove dependencies form build stage that invalidate the cache
cbourjau Apr 27, 2026
dad0e13
Fixes for rattler-build 0.63.1
cbourjau Apr 27, 2026
d6acaac
Set same cxx standard in -cpp and -python scripts
cbourjau Apr 27, 2026
e94db80
Try setting CUDAToolkit_ROOT
cbourjau Apr 27, 2026
c09582b
Use identical dependencies in -build and -python step
cbourjau Apr 28, 2026
dcf6de3
Another try to make cuda find the right headers
cbourjau Apr 28, 2026
1c97045
Disable cuda builds while debugging cache invalidation
cbourjau Aug 9, 2026
c43aea8
Add ninja -d explain for debugging
cbourjau Apr 28, 2026
c1df6e1
Fix copying from staging on Windows
cbourjau Apr 28, 2026
24090bd
Copy bin folder from staging
cbourjau Apr 28, 2026
3c42a1b
Add more debugging diagnostic for cache invalidation
cbourjau Apr 28, 2026
5f178cc
Try THREADS_PREFER_PTHREAD_FLAG=ON to avoid cache invalidation
cbourjau Apr 28, 2026
386e1cc
Add packaging dependency for cross-compilation
cbourjau Apr 28, 2026
d12c600
Add setuptools and wheel dependency
cbourjau Apr 28, 2026
bb40a47
Cross-building fixes
cbourjau Apr 28, 2026
2700d92
Remove debug logic that breaks on windows
cbourjau Apr 28, 2026
f35cac6
Re-enable Python 3.10
cbourjau Apr 29, 2026
2af9a6f
Clean up scripts and remove unused files from package
cbourjau Apr 29, 2026
9524b6d
Rerender with CUDA
cbourjau Aug 9, 2026
00c969a
Revert some file clean ups
cbourjau Apr 29, 2026
30ed8c6
Keep shared library in Python build
cbourjau Apr 30, 2026
0c4d34a
Try building 1.24.4
cbourjau Apr 30, 2026
9a231cf
Use C++ 17 to avoid module scanning issues and disable cuda-tests
cbourjau May 4, 2026
0931b09
Attempt to fix windows CUDA
cbourjau May 4, 2026
1ccc112
Attempt to fix Windows CUDA
cbourjau May 4, 2026
383c64c
Don't look for .lib file
cbourjau May 4, 2026
443734e
Skip windows-only cuda tests
cbourjau May 5, 2026
7a2b328
Update rattler-build recipe for 1.28.0 and port changes from main
hmaarrfk Aug 9, 2026
920d79f
MNT: Re-rendered with conda-smithy 2026.8.9 and conda-forge-pinning 2…
hmaarrfk Aug 9, 2026
8284b5c
Declare extra.feedstock-name to satisfy the linter
hmaarrfk Aug 9, 2026
c2fb86d
Use C++20: required by onnxruntime 1.28.0
hmaarrfk Aug 9, 2026
131d1a7
Fix PATH mangling in Windows CUDA builds
hmaarrfk Aug 9, 2026
23de15c
Use main's per-platform CUDA arch lists on Windows
hmaarrfk Aug 9, 2026
29528d7
Use conda-forge gtest on macOS to avoid std::format availability error
hmaarrfk Aug 9, 2026
29fc923
Glob vendored-dependency licenses instead of itemizing them
hmaarrfk Aug 9, 2026
3bd5020
Itemize vendored licenses explicitly per variant
hmaarrfk Aug 9, 2026
b9d78af
Build the CUDA EP as a standalone plugin package (onnxruntime-ep-cuda)
hmaarrfk Aug 9, 2026
5bc9e78
MNT: Re-rendered with conda-smithy 2026.8.9 and conda-forge-pinning 2…
hmaarrfk Aug 9, 2026
3ccfc11
Fix license list for plugin-only CUDA builds
hmaarrfk Aug 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
141 changes: 0 additions & 141 deletions .azure-pipelines/azure-pipelines-osx.yml
View file
Open in desktop

This file was deleted.

45 changes: 0 additions & 45 deletions ...t/linux_64_c_stdlib_version2.17cuda_compiler_version12.9python3.10.____cpythonsuffix.yaml
View file
Open in desktop

This file was deleted.

45 changes: 0 additions & 45 deletions ...t/linux_64_c_stdlib_version2.17cuda_compiler_version12.9python3.11.____cpythonsuffix.yaml
View file
Open in desktop

This file was deleted.

45 changes: 0 additions & 45 deletions ...t/linux_64_c_stdlib_version2.17cuda_compiler_version12.9python3.12.____cpythonsuffix.yaml
View file
Open in desktop

This file was deleted.

45 changes: 0 additions & 45 deletions ...ort/linux_64_c_stdlib_version2.17cuda_compiler_version12.9python3.14.____cp314suffix.yaml
View file
Open in desktop

This file was deleted.

10 changes: 0 additions & 10 deletions ...ersion12.9python3.13.____cp313suffix.yaml → ...n2.17cuda_compiler_version12.9suffix.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,14 +24,6 @@ docker_image:
- quay.io/condaforge/linux-anvil-x86_64:alma10
github_actions_labels:
- namespace-profile-16cpu-on-linux-64
numpy:
- '2'
pin_run_as_build:
python:
min_pin: x.x
max_pin: x.x
python:
- 3.13.* *_cp313
suffix:
- ''
target_platform:
Expand All @@ -41,5 +33,3 @@ zip_keys:
- cxx_compiler_version
- c_stdlib_version
- cuda_compiler_version
zlib:
- '1'
45 changes: 0 additions & 45 deletions ...x_64_c_stdlib_version2.17cuda_compiler_versionNonepython3.10.____cpythonsuffix-novec.yaml
View file
Open in desktop

This file was deleted.

Loading
Loading