Skip to content

Commit 85f69e7

Browse files
[Klaud Cold] Update minimaxm2.5-fp8-mi300x-vllm vLLM ROCm image to v0.22.0
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 1b71db4 commit 85f69e7

2 files changed

Lines changed: 7 additions & 1 deletion

File tree

.github/configs/amd-master.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -994,7 +994,7 @@ minimaxm2.5-fp4-mi355x-vllm:
994994
- { tp: 4, conc-start: 4, conc-end: 64 }
995995

996996
minimaxm2.5-fp8-mi300x-vllm:
997-
image: vllm/vllm-openai-rocm:v0.21.0
997+
image: vllm/vllm-openai-rocm:v0.22.0
998998
model: MiniMaxAI/MiniMax-M2.5
999999
model-prefix: minimaxm2.5
10001000
runner: mi300x

perf-changelog.yaml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3239,3 +3239,9 @@
32393239
- "Add --compilation-config '{\"mode\":3,\"cudagraph_mode\":\"PIECEWISE\"}' to vllm serve, mirroring `model.base_args` from the upstream recipe. `pass_config.fuse_minimax_qk_norm` from the recipe is intentionally omitted — it triggers an upstream NameError on ROCm because vllm/compilation/passes/pass_manager.py imports MiniMaxQKNormPass under `is_cuda()` (NVIDIA-only) while using it unconditionally"
32403240
- "Conditionally enable VLLM_ROCM_SHUFFLE_KV_CACHE_LAYOUT=1 per (TP, EP, CONC) — on for shapes where the AITER ASM paged-attention kernel exists in the gfx942 heuristic table (TP=2 EP=1 CONC<=16, TP=8 EP=8 CONC<=64), off otherwise. Above the thresholds vllm/v1/attention/backends/rocm_aiter_fa.py routes decode through aiter pa_fwd_asm and crashes with `RuntimeError: get_heuristic_kernel: cannot get heuristic kernel!` for MiniMax-M2.5's attention shape (gqa=6 block_size=32 qTile=0); below them the ASM auto-dispatch is the perf win the recipe wants. Thresholds confirmed across 17 bench cells + 3 eval cells in PR #1594 sweep run 26692603804. Mirrors the per-shape toggle pattern in benchmarks/single_node/minimaxm2.5_fp8_mi355x.sh; can collapse to unconditional SHUFFLE=1 once AITER registers the missing kernel on gfx942"
32413241
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1594
3242+
3243+
- config-keys:
3244+
- minimaxm2.5-fp8-mi300x-vllm
3245+
description:
3246+
- "Update vLLM ROCm image from v0.21.0 to v0.22.0"
3247+
pr-link: PRLINK_PLACEHOLDER

0 commit comments

Comments
 (0)