We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 1bc3973 commit 24f03a0Copy full SHA for 24f03a0
1 file changed
benchmarks/gptoss_fp4_h100_docker.sh
@@ -48,6 +48,6 @@ run_benchmark_serving \
48
--output-len "$OSL" \
49
--random-range-ratio "$RANDOM_RANGE_RATIO" \
50
--num-prompts $(( $CONC * 10 )) \
51
- --max-concurrency 512 \
+ --max-concurrency "$CONC" \
52
--result-filename "$RESULT_FILENAME" \
53
--result-dir /workspace/
0 commit comments