feat(deepep-efa): TensorRT-LLM NcclEP MoE all-to-all over EFA (NCCL-GIN CPU-proxy) - #1240

Open

dmvevents wants to merge 11 commits into

awslabs:mainfrom

dmvevents:feat/trtllm-deepep-efa

Commits on Aug 25, 2026

feat(deepep-efa): TensorRT-LLM NcclEP MoE all-to-all over EFA (NCCL-GIN CPU-proxy)
dmvevents
committed
bf5e5a1
fix(deepep-efa): honor pre-set APPLY_HT_FLAT_PATCH, add TRT-LLM engine index, de-link unmerged sibling
dmvevents
committed
458eac1

Commits on Aug 26, 2026

trtllm/nccl-ep-efa: migrate build to released aws-ofi-nccl v1.21.1 + EFA 1.50.0; justify NCCL 2.30.4 pin
dmvevents
committed
558cd52
trtllm/nccl-ep-efa: RUN_SERVE gate, stable .svc DNS rendezvous, ephemeral-storage reservation, non-privileged gdrdrv variant
dmvevents
committed
dc7120f
trtllm/nccl-ep-efa: recipe robustness — fail-loud NCCL_LIB, collective-safe probe, SIGPIPE-safe verify, benchmark warmup+monotonic index
dmvevents
committed
aafe187
trtllm/nccl-ep-efa: docs — pins/diagram consistency, gdrdrv prereq, .svc DNS commands, transport-vs-selection env split, second int32 exit
dmvevents
committed
e8494dd

Commits on Sep 1, 2026

Commits on Sep 5, 2026

docs(trtllm-nccl-ep-efa): record the concrete ABI reason for the NCCL 2.30.4 pin
dmvevents
committed
b1e44e5