Skip to content

Commit 3c94a6f

Browse files
fix: comments and add perf-changelog.yml
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
1 parent 0c16e44 commit 3c94a6f

3 files changed

Lines changed: 10 additions & 6 deletions

File tree

.github/configs/amd-master.yaml

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1549,7 +1549,6 @@ kimik2.5-fp4-mi355x-vllm-disagg:
15491549
dp-attn: false
15501550
additional-settings:
15511551
- "PREFILL_NODES=1"
1552-
- "VLLM_MORIIO_CONNECTOR_READ_MODE=1"
15531552
decode:
15541553
num-worker: 2
15551554
tp: 8
@@ -1570,7 +1569,6 @@ kimik2.5-fp4-mi355x-vllm-disagg:
15701569
dp-attn: false
15711570
additional-settings:
15721571
- "PREFILL_NODES=1"
1573-
- "VLLM_MORIIO_CONNECTOR_READ_MODE=1"
15741572
decode:
15751573
num-worker: 2
15761574
tp: 8
@@ -1607,7 +1605,6 @@ minimaxm2.5-fp8-mi355x-vllm-disagg:
16071605
dp-attn: false
16081606
additional-settings:
16091607
- "PREFILL_NODES=1"
1610-
- "VLLM_MORIIO_CONNECTOR_READ_MODE=1"
16111608
decode:
16121609
num-worker: 2
16131610
tp: 8
@@ -1628,7 +1625,6 @@ minimaxm2.5-fp8-mi355x-vllm-disagg:
16281625
dp-attn: false
16291626
additional-settings:
16301627
- "PREFILL_NODES=1"
1631-
- "VLLM_MORIIO_CONNECTOR_READ_MODE=1"
16321628
decode:
16331629
num-worker: 2
16341630
tp: 8

benchmarks/multi_node/amd_utils/setup_deps.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,8 @@
33
# setup_deps.sh — Install missing disagg dependencies at container start.
44
#
55
# Dispatched by $ENGINE (set by server.sh dispatcher):
6-
# vllm-disagg -> vLLM/MoRI-IO patches + UCX/RIXL path exports
7-
# (base image: vllm/vllm-openai-rocm:v0.18.0)
6+
# vllm-disagg -> recipe deps + amd-quark + UCX/RIXL path exports
7+
# (base image: vllm/vllm-openai-rocm:nightly)
88
# sglang-disagg -> SGLang aiter gluon patch + per-model installs
99
# (base image: lmsysorg/sglang-rocm:v0.5.12-rocm720-mi35x-*)
1010
#

perf-changelog.yaml

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3200,3 +3200,11 @@
32003200
- "Bump image to lmsysorg/sglang-rocm:v0.5.12.post1-rocm720-mi35x-20260523, 1P1D TP8/EP1, dp-attn false, conc [8..512]"
32013201
- "MoRI conn.py overlay (48e459bd) via job.slurm; launcher qwen3.5_fp4_mi355x_sglang-disagg.sh"
32023202
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1579
3203+
3204+
- config-keys:
3205+
- kimik2.5-fp4-mi355x-vllm-disagg
3206+
- minimaxm2.5-fp8-mi355x-vllm-disagg
3207+
description:
3208+
- "Bump image to vllm/vllm-openai-rocm:nightly (MoRI-IO fixes upstreamed in vllm#40344)"
3209+
- "Rename a2a backend mori to mori_low_latency; set read_mode via kv_connector_extra_config instead of VLLM_MORIIO_CONNECTOR_READ_MODE env var"
3210+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1585

0 commit comments

Comments
 (0)