Skip to content

Commit ddb1201

Browse files
hyukjleeclaude
andcommitted
[AMD][AgentX] kimik3: pair eager+lazy fp8 offload on the new AIPerf warmup
Run 30511545046 tried lazy alone and is uninterpretable. It landed just after #2415 swapped the agentic warmup from --agentic-cache-warmup-duration 600 to --warmup-requests-per-lane 10 (benchmark_lib.sh:1793, plus a new utils/aiperf pin), so it moved two variables at once. Its "0 successful / 49 total, OSL=1" is the new warmup's one-token lane primers, not a lazy-offload symptom -- the cell never left warmup. That also invalidates the seven earlier fp8+offload failures as baselines: all of them ran the old time-based warmup. So run the eager control at c8 on the SAME warmup as lazy, in one dispatch, and compare those two only. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
1 parent 06d8d5f commit ddb1201

1 file changed

Lines changed: 9 additions & 0 deletions

File tree

configs/amd-master.yaml

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -828,6 +828,15 @@ kimik3-fp4-mi355x-vllm-agentic-fp8lazy:
828828
agentic-coding:
829829
- dram-utilization: 0.80
830830
search-space:
831+
# PAIRED. Run 30511545046 tried lazy alone and is uninterpretable: it
832+
# landed after #2415 swapped the agentic warmup from
833+
# --agentic-cache-warmup-duration 600 to --warmup-requests-per-lane 10
834+
# (benchmark_lib.sh:1793, new utils/aiperf pin), so it moved two variables
835+
# at once and died inside the new warmup -- its "0 successful, OSL=1" is
836+
# that warmup's one-token primers, not a lazy symptom. Every earlier
837+
# failure used the old time-based warmup, so none of them is a baseline
838+
# any more. Run the eager control on the SAME warmup as lazy.
839+
- { tp: 8, kv-offloading: dram, kv-offload-backend: { name: vllm-simple-fp8 }, conc-list: [8] }
831840
- { tp: 8, kv-offloading: dram, kv-offload-backend: { name: vllm-simple-fp8-lazy }, conc-list: [8] }
832841

833842
kimik3-fp4-mi355x-vllm-agentic-fp8kv:

0 commit comments

Comments
 (0)