Skip to content

Commit 1820fa9

Browse files
committed
Use TP8 GB200 FP4 agentic topology
1 parent a174186 commit 1820fa9

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

.github/configs/nvidia-master.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4402,9 +4402,9 @@ dsr1-fp4-gb200-dynamo-trt:
44024402
- spec-decoding: "none"
44034403
conc-list: [ 1, 2, 4, 8, 16, 32, 64, 128, 256, 512 ]
44044404
prefill:
4405-
num-worker: 10
4406-
tp: 4
4407-
ep: 4
4405+
num-worker: 5
4406+
tp: 8
4407+
ep: 8
44084408
dp-attn: true
44094409
additional-settings:
44104410
# https://github.com/cquil11/srt-slurm-nv/blob/cam/sa-submission-q2-2026/recipes/trtllm/gb200-fp4/agentic/ctx10_gen1_dep16_60k150.yaml

0 commit comments

Comments
 (0)