Skip to content

Commit 4264cca

Browse files
authored
Fixed optimum version at 1.25.0 (#1784)
optimum version change cause vllm OpenVINO fails to load model Fix #1770 Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
1 parent 1647423 commit 4264cca

2 files changed

Lines changed: 3 additions & 1 deletion

File tree

comps/third_parties/vllm/src/Dockerfile.intel_gpu

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,7 @@ RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" python3 -m pip in
5858
# build vLLM with OpenVINO backend
5959
RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE="openvino" python3 -m pip install --no-cache-dir /workspace/vllm/
6060
# fix OpenVINO version to 25.0.0
61-
RUN python3 -m pip install --no-cache-dir openvino==2025.0.0
61+
RUN python3 -m pip install --no-cache-dir openvino==2025.0.0 optimum==1.25.0
6262

6363
#COPY examples/ /workspace/vllm/examples
6464
#COPY benchmarks/ /workspace/vllm/benchmarks

tests/third_parties/test_third_parties_vllm_openvino_on_intel_arc.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,8 @@ export host_ip=$(hostname -I | awk '{print $1}')
1515
LOG_PATH="$WORKPATH/tests"
1616
service_name="vllm-openvino-arc"
1717

18+
# workaround to fix optimum at 1.25.0
19+
1820
function build_container() {
1921
cd $WORKPATH
2022
docker build --no-cache -t ${REGISTRY:-opea}/vllm-arc:${TAG:-latest} -f comps/third_parties/vllm/src/Dockerfile.intel_gpu . --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy

0 commit comments

Comments
 (0)