Skip to content

Commit 5bdbd31

Browse files
authored
Update dsr1_fp4_mi355x_slurm.sh
1 parent 07d3877 commit 5bdbd31

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

benchmarks/dsr1_fp4_mi355x_slurm.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,7 @@
1010
# RANDOM_RANGE_RATIO
1111
# RESULT_FILENAME
1212
export SGLANG_USE_AITER=1
13+
export ROCM_QUICK_REDUCE_QUANTIZATION=INT4
1314
SERVER_LOG=$(mktemp /tmp/server-XXXXXX.log)
1415

1516
PREFILL_SIZE=196608

0 commit comments

Comments
 (0)