Skip to content

Commit e8b0d15

Browse files
[Klaud Cold] Update dsv4-fp8-h200-vllm (+mtp) vLLM image to v0.22.0
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 1b71db4 commit e8b0d15

2 files changed

Lines changed: 9 additions & 2 deletions

File tree

.github/configs/nvidia-master.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2884,7 +2884,7 @@ dsr1-fp8-h200-sglang-mtp:
28842884
# Uses the cu129 image. H200 has no FP4 path, so the FP4 indexer cache
28852885
# flag is omitted. Max-model-len is pinned at 800k per the recipe.
28862886
dsv4-fp8-h200-vllm:
2887-
image: vllm/vllm-openai:v0.21.0
2887+
image: vllm/vllm-openai:v0.22.0
28882888
model: deepseek-ai/DeepSeek-V4-Pro
28892889
model-prefix: dsv4
28902890
runner: h200
@@ -2908,7 +2908,7 @@ dsv4-fp8-h200-vllm:
29082908
# (the non-MTP entry above is still on the deepseekv4-cu129 tag) and adds
29092909
# --speculative-config '{"method":"mtp","num_speculative_tokens":2}'.
29102910
dsv4-fp8-h200-vllm-mtp:
2911-
image: vllm/vllm-openai:v0.21.0
2911+
image: vllm/vllm-openai:v0.22.0
29122912
model: deepseek-ai/DeepSeek-V4-Pro
29132913
model-prefix: dsv4
29142914
runner: h200

perf-changelog.yaml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3239,3 +3239,10 @@
32393239
- "Add --compilation-config '{\"mode\":3,\"cudagraph_mode\":\"PIECEWISE\"}' to vllm serve, mirroring `model.base_args` from the upstream recipe. `pass_config.fuse_minimax_qk_norm` from the recipe is intentionally omitted — it triggers an upstream NameError on ROCm because vllm/compilation/passes/pass_manager.py imports MiniMaxQKNormPass under `is_cuda()` (NVIDIA-only) while using it unconditionally"
32403240
- "Conditionally enable VLLM_ROCM_SHUFFLE_KV_CACHE_LAYOUT=1 per (TP, EP, CONC) — on for shapes where the AITER ASM paged-attention kernel exists in the gfx942 heuristic table (TP=2 EP=1 CONC<=16, TP=8 EP=8 CONC<=64), off otherwise. Above the thresholds vllm/v1/attention/backends/rocm_aiter_fa.py routes decode through aiter pa_fwd_asm and crashes with `RuntimeError: get_heuristic_kernel: cannot get heuristic kernel!` for MiniMax-M2.5's attention shape (gqa=6 block_size=32 qTile=0); below them the ASM auto-dispatch is the perf win the recipe wants. Thresholds confirmed across 17 bench cells + 3 eval cells in PR #1594 sweep run 26692603804. Mirrors the per-shape toggle pattern in benchmarks/single_node/minimaxm2.5_fp8_mi355x.sh; can collapse to unconditional SHUFFLE=1 once AITER registers the missing kernel on gfx942"
32413241
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1594
3242+
3243+
- config-keys:
3244+
- dsv4-fp8-h200-vllm
3245+
- dsv4-fp8-h200-vllm-mtp
3246+
description:
3247+
- "Update vLLM image from v0.21.0 to v0.22.0"
3248+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1597

0 commit comments

Comments
 (0)