Skip to content

Mirror GPU resource slices to NVIDIA_VISIBLE_DEVICES#9

Closed
v-shobhit wants to merge 4 commits into
NVIDIA:mainfrom
v-shobhit:codex/mirror-gpu-slice-to-nvidia-visible-devices
Closed

Mirror GPU resource slices to NVIDIA_VISIBLE_DEVICES#9
v-shobhit wants to merge 4 commits into
NVIDIA:mainfrom
v-shobhit:codex/mirror-gpu-slice-to-nvidia-visible-devices

Conversation

@v-shobhit

Copy link
Copy Markdown

Summary

  • Mirror SFlow GPU resource slices into NVIDIA_VISIBLE_DEVICES alongside CUDA_VISIBLE_DEVICES
  • Keep CUDA and NVIDIA container visibility aligned for srun/Pyxis tasks
  • Document both env vars in GPU resource and replica docs

Test Plan

  • uv run pytest tests/unit/test_app_assembly_build_task_graph.py -k "resources_gpus_count_sets_cuda_visible_devices_with_offset or resources_gpus_respects_compute_node_num_gpus"

@RogerLiu312

Copy link
Copy Markdown
Collaborator

Now we export both 2 envs with identical slices, see: https://github.com/NVIDIA/nv-sflow/blob/main/src/sflow/core/backend.py#L129

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants