Skip to content

Commit 814266f

Browse files
committed
fix(vllm_inference): upgrade vLLM to 0.19.1 for transformers 5.x compat
Signed-off-by: svc-bionemo <267129667+svc-bionemo@users.noreply.github.com>
1 parent 748ec4c commit 814266f

3 files changed

Lines changed: 1 addition & 6 deletions

File tree

.github/workflows/unit-tests-recipes.yml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,6 @@ jobs:
5656
bionemo-recipes/models/**
5757
bionemo-recipes/recipes/**
5858
!bionemo-recipes/recipes/*megatron/**
59-
!bionemo-recipes/recipes/vllm_inference/**
6059
6160
- id: set-dirs
6261
name: Determine which directories to run

bionemo-recipes/recipes/vllm_inference/esm2/install_vllm.sh

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,14 +9,13 @@ echo "Building vLLM for CUDA arch: $ARCH (MAX_JOBS=$MAX_JOBS)"
99

1010
cd /workspace
1111
if [ ! -d vllm ]; then
12-
git clone --branch v0.15.1 --depth 1 https://github.com/vllm-project/vllm.git
12+
git clone --branch v0.19.1 --depth 1 https://github.com/vllm-project/vllm.git
1313
fi
1414
cd vllm
1515
python use_existing_torch.py
1616
TORCH_CUDA_ARCH_LIST="$ARCH" MAX_JOBS="$MAX_JOBS" \
1717
uv pip install -r requirements/build.txt --system
1818
TORCH_CUDA_ARCH_LIST="$ARCH" MAX_JOBS="$MAX_JOBS" \
1919
uv pip install --no-build-isolation -e . --system
20-
pip install --upgrade "transformers[torch]"
2120

2221
echo "vLLM installed for arch $ARCH"

bionemo-recipes/recipes/vllm_inference/esm2/tests/test_vllm.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,6 @@
2222
so the HuggingFace paths replicate that post-processing for comparison.
2323
"""
2424

25-
from pathlib import Path
26-
2725
import numpy as np
2826
import pytest
2927
import torch
@@ -44,7 +42,6 @@
4442

4543
EXPORT_TAG = "esm2_t6_8M_UR50D"
4644
REFERENCE_MODEL_ID = "nvidia/esm2_t6_8M_UR50D"
47-
ESM2_MODEL_DIR = Path(__file__).resolve().parent.parent
4845

4946
SEQUENCES = [
5047
"LKGHAMCLGCLHMLMCGLLAGAMCGLMKLLKCCGKCLMHLMKAMLGLKCACHHHHLLLHACAAKKLCLGAKLAMGLKLLGAHGKGLKMACGHHMLHLHMH",

0 commit comments

Comments
 (0)