Skip to content

Commit 9b3912e

Browse files
seungrokjclaude
andcommitted
[AMD] [AGENTX] dsv4-fp4-mi355x-sglang-agentic-mtp: add TP8 dp-off conc 1,2 arm
Add a pure-TP (dp-attn false) low-concurrency arm (conc 1,2, spec-decoding mtp) alongside the existing DEP conc 4-32 arm. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent b582eb1 commit 9b3912e

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

configs/amd-master.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1695,6 +1695,7 @@ dsv4-fp4-mi355x-sglang-agentic-mtp:
16951695
agentic-coding:
16961696
- dram-utilization: 0.80
16971697
search-space:
1698+
- { tp: 8, dp-attn: false, kv-offloading: none, conc-list: [1, 2], spec-decoding: mtp }
16981699
- { tp: 8, dp-attn: true, kv-offloading: none, conc-list: [4, 8, 16, 32], spec-decoding: mtp }
16991700

17001701
# MiniMax-M3 MXFP8 MI355X recipe:

0 commit comments

Comments
 (0)