Skip to content

Commit f5fa87e

Browse files
committed
Change mem-fraction-static back to 0.8
1 parent a7b115d commit f5fa87e

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

benchmarks/single_node/fixed_seq_len/qwen3.5_fp8_mi355x.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ python3 -m sglang.launch_server \
4545
--disable-radix-cache \
4646
--chunked-prefill-size 32768 \
4747
--scheduler-recv-interval 30 \
48-
--mem-fraction-static 0.9 \
48+
--mem-fraction-static 0.8 \
4949
--model-loader-extra-config '{"enable_multithread_load": true}' \
5050
--page-size 16 $EVAL_CONTEXT_ARGS > $SERVER_LOG 2>&1 &
5151

benchmarks/single_node/fixed_seq_len/qwen3.5_fp8_mi355x_mtp.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ python3 -m sglang.launch_server \
4545
--disable-radix-cache \
4646
--chunked-prefill-size 32768 \
4747
--scheduler-recv-interval 30 \
48-
--mem-fraction-static 0.9 \
48+
--mem-fraction-static 0.8 \
4949
--model-loader-extra-config '{"enable_multithread_load": true}' \
5050
--page-size 16 \
5151
--speculative-algorithm EAGLE \

0 commit comments

Comments
 (0)