Skip to content

Commit a99755d

Browse files
committed
stop vllm to stdout after it stops
1 parent 221ea1a commit a99755d

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

benchmarks/gptoss_fp4_h100_docker.sh

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,11 +31,17 @@ vllm serve $MODEL --host=0.0.0.0 --port=$PORT \
3131
--max-num-seqs=$CONC \
3232
--disable-log-requests &
3333

34+
SERVER_PID=$!
3435
set +x
36+
tail -f /tmp/vllm_server.log &
37+
TAIL_PID=$!
38+
3539
until curl --output /dev/null --silent --fail http://localhost:$PORT/health; do
3640
sleep 5
3741
done
3842

43+
kill $TAIL_PID 2>/dev/null
44+
3945
pip install -q datasets pandas
4046
git clone https://github.com/kimbochen/bench_serving.git
4147
set -x

0 commit comments

Comments
 (0)