Skip to content

Commit fa7cbca

Browse files
committed
fix port issue for dsr1 mi300x docker
1 parent d36965a commit fa7cbca

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

benchmarks/dsr1_fp8_mi300x_docker.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ set -x
5151
BENCH_SERVING_DIR=$(mktemp -d /tmp/bmk-XXXXXX)
5252
git clone https://github.com/kimbochen/bench_serving.git $BENCH_SERVING_DIR
5353
python3 $BENCH_SERVING_DIR/benchmark_serving.py \
54-
--model=$MODEL --backend=vllm --base-url=http://$server_name:$PORT \
54+
--model=$MODEL --backend=vllm --base-url=http://0.0.0.0:$PORT \
5555
--dataset-name=random \
5656
--random-input-len=$ISL --random-output-len=$OSL --random-range-ratio=$RANDOM_RANGE_RATIO \
5757
--num-prompts=$(( $CONC * 10 )) \

0 commit comments

Comments
 (0)