Skip to content

Commit 7695122

Browse files
Update qwen3.5-bf16-mi355x-sglang and mtp SGLang ROCm image to v0.5.12-rocm720-mi35x-20260517
Ref #1154 Co-authored-by: Klaud Cold <Klaud-Cold@users.noreply.github.com>
1 parent 958c62d commit 7695122

2 files changed

Lines changed: 9 additions & 2 deletions

File tree

.github/configs/amd-master.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,7 @@ dsr1-fp8-mi355x-sglang:
124124
- { tp: 8, conc-start: 4, conc-end: 64 }
125125

126126
qwen3.5-bf16-mi355x-sglang:
127-
image: lmsysorg/sglang-rocm:v0.5.10rc0-rocm720-mi35x-20260415
127+
image: lmsysorg/sglang-rocm:v0.5.12-rocm720-mi35x-20260517
128128
model: Qwen/Qwen3.5-397B-A17B
129129
model-prefix: qwen3.5
130130
runner: mi355x
@@ -143,7 +143,7 @@ qwen3.5-bf16-mi355x-sglang:
143143
- { tp: 8, ep: 1, conc-start: 4, conc-end: 256 }
144144

145145
qwen3.5-bf16-mi355x-sglang-mtp:
146-
image: lmsysorg/sglang-rocm:v0.5.10rc0-rocm720-mi35x-20260415
146+
image: lmsysorg/sglang-rocm:v0.5.12-rocm720-mi35x-20260517
147147
model: Qwen/Qwen3.5-397B-A17B
148148
model-prefix: qwen3.5
149149
runner: mi355x

perf-changelog.yaml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2623,3 +2623,10 @@
26232623
description:
26242624
- "Update vLLM image from v0.15.1 to v0.20.2"
26252625
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1394
2626+
2627+
- config-keys:
2628+
- qwen3.5-bf16-mi355x-sglang
2629+
- qwen3.5-bf16-mi355x-sglang-mtp
2630+
description:
2631+
- "Update SGLang ROCm image from v0.5.10rc0-rocm720-mi35x-20260415 to v0.5.12-rocm720-mi35x-20260517"
2632+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/XXX

0 commit comments

Comments
 (0)