Skip to content

Commit f9d6523

Browse files
committed
fix(profile): capture one profiling step
1 parent 39f914b commit f9d6523

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

utils/bench_serving/benchmark_serving.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -538,7 +538,7 @@ async def warmup_limited_req_fn():
538538
api_url=base_url + "/start_profile",
539539
prompt_len=test_prompt_len,
540540
output_len=test_output_len,
541-
extra_body={"num_steps": 2, "merge_profiles": True, "profile_by_stage": True},
541+
extra_body={"num_steps": 1, "merge_profiles": True, "profile_by_stage": True},
542542
logprobs=logprobs,
543543
best_of=best_of,
544544
multi_modal_content=test_mm_content,

0 commit comments

Comments
 (0)