Skip to content

Commit 1092b8c

Browse files
hyukjleeclaude
andcommitted
[AMD][AgentX] kimik2.7: split Mooncake into its own tune key (fail-fast isolation)
The DEP Mooncake c16 cell fails fast at bringup; GH matrix fail-fast then cancels the still-running LMCache/pure-TP cells before they finish. Split the LMCache scaling experiment (-tune) from Mooncake (-tune-mc) so a Mooncake bringup failure can't poison the scaling run, and so Mooncake runs alone and uploads its own server_logs for diagnosis. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent a63228b commit 1092b8c

1 file changed

Lines changed: 20 additions & 4 deletions

File tree

configs/amd-master.yaml

Lines changed: 20 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -574,9 +574,10 @@ kimik2.7-fp4-mi355x-vllm-agentic:
574574
# Perf-tuning experiment key (same recipe as the record sweep above, via
575575
# model-prefix kimik2.7). Goal: get a throughput curve that scales with
576576
# concurrency instead of collapsing. Compares pure-TP8 (current, capacity-capped)
577-
# vs DEP (data-parallel attention TP1xDP8 + expert parallelism), each with an
578-
# LMCache/Mooncake KV tier. Dispatched at 900s via e2e-tests duration override to
579-
# verify the perf delta before committing a full 3600s run.
577+
# vs DEP (data-parallel attention TP1xDP8 + expert parallelism), both with LMCache.
578+
# Dispatched at 900s via e2e-tests duration override to verify the perf delta
579+
# before committing a full 3600s run. Mooncake is split into a separate key
580+
# (-tune-mc) so a fast Mooncake bringup failure can't fail-fast-cancel these cells.
580581
kimik2.7-fp4-mi355x-vllm-agentic-tune:
581582
image: vllm/vllm-openai-rocm:v0.24.0
582583
model: amd/Kimi-K2.7-Code-MXFP4
@@ -592,7 +593,22 @@ kimik2.7-fp4-mi355x-vllm-agentic-tune:
592593
search-space:
593594
- { tp: 8, dp-attn: false, ep: 1, kv-offloading: dram, kv-offload-backend: { name: lmcache, version: "aaf7c0d3" }, conc-list: [16, 32, 48] }
594595
- { tp: 8, dp-attn: true, ep: 8, kv-offloading: dram, kv-offload-backend: { name: lmcache, version: "aaf7c0d3" }, conc-list: [16, 32, 48] }
595-
- { tp: 8, dp-attn: true, ep: 8, kv-offloading: dram, kv-offload-backend: { name: mooncake, version: "source-main" }, conc-list: [16, 32, 48] }
596+
597+
# Mooncake-under-DEP, isolated so its failure can't cancel the LMCache scaling run.
598+
kimik2.7-fp4-mi355x-vllm-agentic-tune-mc:
599+
image: vllm/vllm-openai-rocm:v0.24.0
600+
model: amd/Kimi-K2.7-Code-MXFP4
601+
model-prefix: kimik2.7
602+
runner: cluster:mi355x-amds
603+
precision: fp4
604+
framework: vllm
605+
multinode: false
606+
scenarios:
607+
agentic-coding:
608+
- dram-utilization: 0.80
609+
duration: 900
610+
search-space:
611+
- { tp: 8, dp-attn: true, ep: 8, kv-offloading: dram, kv-offload-backend: { name: mooncake, version: "source-main" }, conc-list: [16, 32, 48] }
596612

597613

598614
kimik2.5-fp4-mi355x-atom:

0 commit comments

Comments
 (0)