Skip to content

Commit 32c0d57

Browse files
committed
clone bench serving to tmp dir pt 2
1 parent 47249d6 commit 32c0d57

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

benchmarks/gptoss_fp4_h100_docker.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ pip install -q datasets pandas
4444
BENCH_SERVING_DIR=$(mktemp -d /tmp/bmk-XXXXXX)
4545
git clone https://github.com/kimbochen/bench_serving.git $BENCH_SERVING_DIR
4646
set -x
47-
python3 $BENCH_SERVING_DIR/bench_serving/benchmark_serving.py \
47+
python3 $BENCH_SERVING_DIR/benchmark_serving.py \
4848
--model=$MODEL \
4949
--backend=vllm \
5050
--base-url=http://localhost:$PORT \

0 commit comments

Comments
 (0)