Skip to content

Commit 89c52b8

Browse files
committed
fix: tp symm mem; pending PR #48843 to reenable
1 parent 351db64 commit 89c52b8

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

benchmarks/multi_node/srt-slurm-recipes/vllm/deepseek-v4/agentic/agg-gb300-tp4-agentic.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,7 @@ backend:
7272
VLLM_ENGINE_READY_TIMEOUT_S: "3600"
7373
VLLM_RPC_TIMEOUT: "600000"
7474
TILELANG_CLEANUP_TEMP_FILES: "1"
75-
VLLM_USE_NCCL_SYMM_MEM: "1"
75+
VLLM_ALLREDUCE_USE_SYMM_MEM: "0"
7676
VLLM_USE_BREAKABLE_CUDAGRAPH: "0"
7777
TORCH_SYMMMEM: "NVSHMEM"
7878
NCCL_CUMEM_ENABLE: "1"

benchmarks/multi_node/srt-slurm-recipes/vllm/deepseek-v4/agentic/agg-gb300-tp8-agentic.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,7 @@ backend:
7272
VLLM_ENGINE_READY_TIMEOUT_S: "3600"
7373
VLLM_RPC_TIMEOUT: "600000"
7474
TILELANG_CLEANUP_TEMP_FILES: "1"
75-
VLLM_USE_NCCL_SYMM_MEM: "1"
75+
VLLM_ALLREDUCE_USE_SYMM_MEM: "0"
7676
VLLM_USE_BREAKABLE_CUDAGRAPH: "0"
7777
TORCH_SYMMMEM: "NVSHMEM"
7878
NCCL_CUMEM_ENABLE: "1"

0 commit comments

Comments
 (0)