Skip to content

Commit 9dfd033

Browse files
[Klaud Cold] Update minimaxm2.5-fp4-b300-vllm vLLM image to v0.22.0
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 1b71db4 commit 9dfd033

2 files changed

Lines changed: 7 additions & 1 deletion

File tree

.github/configs/nvidia-master.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4466,7 +4466,7 @@ minimaxm2.5-fp4-b200-vllm-agentic:
44664466
# MiniMax-M2.5 FP4 B200 vLLM recipe as-is until B300-specific tuning is available.
44674467

44684468
minimaxm2.5-fp4-b300-vllm:
4469-
image: vllm/vllm-openai:v0.21.0
4469+
image: vllm/vllm-openai:v0.22.0
44704470
model: nvidia/MiniMax-M2.5-NVFP4
44714471
model-prefix: minimaxm2.5
44724472
runner: b300

perf-changelog.yaml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3239,3 +3239,9 @@
32393239
- "Add --compilation-config '{\"mode\":3,\"cudagraph_mode\":\"PIECEWISE\"}' to vllm serve, mirroring `model.base_args` from the upstream recipe. `pass_config.fuse_minimax_qk_norm` from the recipe is intentionally omitted — it triggers an upstream NameError on ROCm because vllm/compilation/passes/pass_manager.py imports MiniMaxQKNormPass under `is_cuda()` (NVIDIA-only) while using it unconditionally"
32403240
- "Conditionally enable VLLM_ROCM_SHUFFLE_KV_CACHE_LAYOUT=1 per (TP, EP, CONC) — on for shapes where the AITER ASM paged-attention kernel exists in the gfx942 heuristic table (TP=2 EP=1 CONC<=16, TP=8 EP=8 CONC<=64), off otherwise. Above the thresholds vllm/v1/attention/backends/rocm_aiter_fa.py routes decode through aiter pa_fwd_asm and crashes with `RuntimeError: get_heuristic_kernel: cannot get heuristic kernel!` for MiniMax-M2.5's attention shape (gqa=6 block_size=32 qTile=0); below them the ASM auto-dispatch is the perf win the recipe wants. Thresholds confirmed across 17 bench cells + 3 eval cells in PR #1594 sweep run 26692603804. Mirrors the per-shape toggle pattern in benchmarks/single_node/minimaxm2.5_fp8_mi355x.sh; can collapse to unconditional SHUFFLE=1 once AITER registers the missing kernel on gfx942"
32413241
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1594
3242+
3243+
- config-keys:
3244+
- minimaxm2.5-fp4-b300-vllm
3245+
description:
3246+
- "Update vLLM image from v0.21.0 to v0.22.0"
3247+
pr-link: PRLINK_PLACEHOLDER

0 commit comments

Comments
 (0)