Skip to content

Update CUDA build - #77

Draft
chadalon wants to merge 3 commits into
sandialabs:ci-imagesfrom
NexGenAnalytics:cuda-build-update
Draft

chadalon wants to merge 3 commits into
sandialabs:ci-imagesfrom
NexGenAnalytics:cuda-build-update

Conversation

@chadalon

@chadalon chadalon commented Sep 11, 2026 •

Copy link
Copy Markdown
Collaborator
  • Bumps Kokkos version to 5.1.1
    • Removes cuda_lambda since Kokkos 5 rejects it (still effectively enabled through Kokkos/nvcc_wrapper flags)
  • add cuda_constexpr to more closely replicate Sandia apps

We also may want to consider adding +cuda_relocatable_device_code and/or several other changes to more closely replicate Sandia apps. We could also add more images for these build variants. Here is a branch that more closely replicates this environment: (https://github.com/sandialabs/distBVH/tree/config-testing)
I also haven't looked into what the CI is doing on the develop branch and if we need to update anything over there.

Build Fail

  1. Upgrading to Kokkos 5.1.1 now causes distBVH to fail building. The fix for this is here: Fix host split setup for CUDA entity views nmm0/distBVH#1
  2. Adding cuda_constexpr brings up device compilation errors in vt (so maybe hold off merging until this is resolved, or we could add cuda_constexpr later). There are multiple potential fixes for this, either addressing constexpr in vt (#2526: constexpr breaks CUDA relaxed-constexpr builds DARMA-tasking/vt#2527) and/or adding an opt-in target to magistrate so vt isn't compiled as device code (#414: Base Magistrate target forces Kokkos CUDA Compilation DARMA-tasking/magistrate#415)

@chadalon chadalon changed the title Update CUDA build to match Sandia systems Update CUDA build Sep 11, 2026
@cwschilly

Copy link
Copy Markdown
Collaborator

CI pipeline fails to build vt with cuda_constexpr enabled. This is fixed by this PR to VT: DARMA-tasking/vt#2527

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants