Skip to content

Commit 1b39c51

Browse files
committed
perf(agentx): roll out deterministic warmup
1 parent 374e017 commit 1b39c51

1 file changed

Lines changed: 7 additions & 0 deletions

File tree

perf-changelog.yaml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5230,3 +5230,10 @@
52305230
- "Bump image to vllm/vllm-openai:nightly-4080263bb2c5d10deac17aaeb88e0823bc35bca9 and dynamo to 1.3.0.dev20260710; drop the minimax-m3-gb300-vllm-fixes.sh setup patch (shipped in the nightly image)"
52315231
- "Collapse the 2xDEP8 decode into a single DEP16 worker (decode_workers 2->1, gpus_per_decode 8->16, data-parallel-size 8->16); recipe renamed 3p2d-dep2-dep8 -> 3p1d-dep2-dep16 (conc 512). The remaining decodes are 1xDEP8 or TEP and are unchanged."
52325232
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2340
5233+
5234+
- config-keys:
5235+
- kimik3-fp4-b300-vllm-agentic
5236+
description:
5237+
- "Pin shared AIPerf to c57ad643 and replace duration-based warmup with 10 deterministic requests per lane."
5238+
- "Use one warmup request per lane with the 20-minute agentx-fast profile, and emit TTFT, ITL, and throughput metrics every 30 seconds."
5239+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2415

0 commit comments

Comments
 (0)