Skip to content

Commit 07d3877

Browse files
authored
Update dsr1_fp4_mi355x_docker.sh with env flags
1 parent a470d47 commit 07d3877

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

benchmarks/dsr1_fp4_mi355x_docker.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,7 @@
1111
# RESULT_FILENAME
1212
# NUM_PROMPTS
1313
export SGLANG_USE_AITER=1
14+
export ROCM_QUICK_REDUCE_QUANTIZATION=INT4
1415

1516
PREFILL_SIZE=196608
1617
if [[ "$ISL" == "8192" && "$OSL" == "1024" ]]; then

0 commit comments

Comments
 (0)