Skip to content

Commit 04e30f3

Browse files
committed
add wait for h200 slurm dsr1
1 parent b4eb57e commit 04e30f3

1 file changed

Lines changed: 9 additions & 0 deletions

File tree

benchmarks/dsr1_fp8_h200_slurm.sh

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,15 @@ else
4444
> $SERVER_LOG 2>&1 &
4545
fi
4646

47+
# Show logs until server is ready
48+
tail -f $SERVER_LOG &
49+
TAIL_PID=$!
50+
set +x
51+
until curl --output /dev/null --silent --fail http://0.0.0.0:$PORT/health; do
52+
sleep 5
53+
done
54+
kill $TAIL_PID
55+
4756
set -x
4857
BENCH_SERVING_DIR=$(mktemp -d /tmp/bmk-XXXXXX)
4958
git clone https://github.com/kimbochen/bench_serving.git $BENCH_SERVING_DIR

0 commit comments

Comments
 (0)