Skip to content

Commit 7ee5bdb

Browse files
committed
add script mode
1 parent d82c9a6 commit 7ee5bdb

2 files changed

Lines changed: 3 additions & 1 deletion

File tree

.github/configs/nvidia-master.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -840,6 +840,7 @@ dsr1-fp8-gb200-dynamo-sglang:
840840
additional-settings:
841841
- "PREFILL_NODES=6"
842842
- "N_ADDITIONAL_FRONTENDS=9"
843+
- "SCRIPT_MODE=1p_4d"
843844
decode:
844845
num-worker: 1
845846
tp: 1

benchmarks/dsr1_fp8_gb200_dynamo-sglang_slurm.sh

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,4 +35,5 @@ bash ./submit_disagg.sh $PREFILL_NODES \
3535
$DECODE_NODES \
3636
$DECODE_NUM_WORKERS \
3737
$N_ADDITIONAL_FRONTENDS \
38-
$ISL $OSL "${CONC_LIST// /x}" inf
38+
$ISL $OSL "${CONC_LIST// /x}" inf \
39+
$SCRIPT_MODE

0 commit comments

Comments
 (0)