Commit 45e8f55
authored
Remove NCCL_NET_GDR_LEVEL=LOC from VERL/OpenRLHF Dockerfiles (#1106)
NCCL_NET_GDR_LEVEL=LOC disables GPU Direct RDMA over the network — every
cross-node GPU↔GPU transfer is staged through host memory, defeating the
purpose of EFA on p5/p5e/p5en/p6.
Removing the override lets the aws-ofi-nccl plugin (bundled with the EFA
installer, built with --enable-platform-aws) select the appropriate GDR
level via the per-instance NCCL_TOPO_FILE it auto-loads.1 parent 0c1f068 commit 45e8f55
3 files changed
Lines changed: 0 additions & 3 deletions
File tree
- 3.test_cases/pytorch
- openrlhf
- verl
- hyperpod-eks/rlvr
- kubernetes/rlvr
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
63 | 63 | | |
64 | 64 | | |
65 | 65 | | |
66 | | - | |
67 | 66 | | |
68 | 67 | | |
69 | 68 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
78 | 78 | | |
79 | 79 | | |
80 | 80 | | |
81 | | - | |
82 | 81 | | |
83 | 82 | | |
84 | 83 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
79 | 79 | | |
80 | 80 | | |
81 | 81 | | |
82 | | - | |
83 | 82 | | |
84 | 83 | | |
85 | 84 | | |
| |||
0 commit comments