Skip to content

Commit 2dbc908

Browse files
committed
fix: pin vLLM version in ROCm install to avoid silent CUDA wheel fallback
Without pinning, uv resolves vllm against both PyPI and our extra ROCm wheel index. If a newer vLLM lands on PyPI before the matching ROCm wheel is published there, --index-strategy unsafe-best-match would pick the higher PyPI version — silently installing a CUDA-only wheel into the ROCm image. Pinning vllm==${VLLM_ROCM_VERSION} ensures both the version and the wheel source are driven by VLLM_ROCM_VERSION.
1 parent e59ba7c commit 2dbc908

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -180,7 +180,7 @@ USER modelrunner
180180
RUN curl -LsSf https://astral.sh/uv/install.sh | sh \
181181
&& ~/.local/bin/uv venv --python 3.12 /opt/vllm-env \
182182
&& . /opt/vllm-env/bin/activate \
183-
&& ~/.local/bin/uv pip install vllm \
183+
&& ~/.local/bin/uv pip install "vllm==${VLLM_ROCM_VERSION}" \
184184
--extra-index-url https://wheels.vllm.ai/rocm/${VLLM_ROCM_VERSION}/${VLLM_ROCM_TARGET} \
185185
--index-strategy unsafe-best-match
186186

0 commit comments

Comments
 (0)