Skip to content

Ray DLC v1.1.0 - bump ray serve to 2.55.1 & transformers to 5.8.0 #6049

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jinyan-li1 merged 13 commits into from
May 12, 2026
Merged

Ray DLC v1.1.0 - bump ray serve to 2.55.1 & transformers to 5.8.0 #6049

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
ad5d49b
ray v1.1.0 bump transformers to 5.8.0
jinyan-li1 May 6, 2026
16ee84c
bump ray to 2.55.1, remove ray CVE allowlist, add CUDA allowlist
jinyan-li1 May 6, 2026
c545bca
change to use uv.lock
jinyan-li1 May 6, 2026
ad92afe
add allowlists
jinyan-li1 May 6, 2026
45c69cd
add privacy-filter sagemaker endpoint test
jinyan-li1 May 7, 2026
0d9a0b9
add negative test sample
jinyan-li1 May 8, 2026
813cb19
fix lint in scripts/autocurrency/agent-fix.py
jinyan-li1 May 8, 2026
3cc925e
switch privacy-filter test to opf decoder output shape
jinyan-li1 May 8, 2026
639df69
Merge branch 'main' into upgrade-ray
jinyan-li1 May 9, 2026
dcafe4d
add /opt/ml/model/code to PYTHONPATH for SDK-packaged tarballs
jinyan-li1 May 11, 2026
be0e109
restore scripts/autocurrency/agent-fix.py to main
jinyan-li1 May 11, 2026
015208d
formatting
jinyan-li1 May 11, 2026
56788da
bump urllib3
jinyan-li1 May 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/config/image/ray-ec2-cpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image:
# Build configuration
common:
framework: "ray"
framework_version: "2.54.1"
framework_version: "2.55.1"
job_type: "inference"
python_version: "py313"
os_version: "amzn2023"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/ray-ec2-gpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image:
# Build configuration
common:
framework: "ray"
framework_version: "2.54.1"
framework_version: "2.55.1"
job_type: "inference"
python_version: "py313"
cuda_version: "cu129"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/ray-sagemaker-cpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image:
# Build configuration
common:
framework: "ray"
framework_version: "2.54.1"
framework_version: "2.55.1"
job_type: "inference"
python_version: "py313"
os_version: "amzn2023"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/ray-sagemaker-gpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image:
# Build configuration
common:
framework: "ray"
framework_version: "2.54.1"
framework_version: "2.55.1"
job_type: "inference"
python_version: "py313"
cuda_version: "cu129"
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/autorelease-ray.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -368,7 +368,7 @@ jobs:
aws-account-id: ${{ vars.CI_AWS_ACCOUNT_ID }}
aws-region: ${{ vars.AWS_REGION }}
framework: ray
framework-version: "2.54.1"
framework-version: "2.55.1"
python-version: py313
cuda-version: ${{ matrix.cuda-version }}
os-version: amzn2023
Expand Down Expand Up @@ -627,7 +627,7 @@ jobs:
aws-account-id: ${{ vars.CI_AWS_ACCOUNT_ID }}
aws-region: ${{ vars.AWS_REGION }}
framework: ray
framework-version: "2.54.1"
framework-version: "2.55.1"
container-type: inference

# ============================================================
Expand Down
12 changes: 8 additions & 4 deletions docker/ray/Dockerfile.cpu
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,12 @@ COPY ./scripts/common/install_python.sh /tmp/install_python.sh
RUN bash /tmp/install_python.sh ${PYTHON_VERSION} && rm /tmp/install_python.sh

# Install pinned dependencies
COPY ./scripts/ray/requirements.lock /tmp/requirements.lock
RUN --mount=type=cache,target=/root/.cache/pip pip install -r /tmp/requirements.lock
COPY --from=ghcr.io/astral-sh/uv:0.11.10 /uv /usr/local/bin/uv
ENV UV_PROJECT_ENVIRONMENT=/usr/local
COPY ./docker/ray/pyproject.toml ./docker/ray/uv.lock /tmp/deps/
RUN --mount=type=cache,target=/root/.cache/uv cd /tmp/deps \
&& uv sync --frozen --no-dev --no-install-project \
&& rm -rf /tmp/deps


#############
Expand All @@ -53,11 +57,11 @@ RUN dnf upgrade -y --security --releasever latest && dnf clean all && rm -rf /va

LABEL maintainer="Amazon AI"
LABEL dlc_major_version="1"
LABEL dlc_minor_version="0"
LABEL dlc_minor_version="1"

ARG PYTHON="python"
ARG FRAMEWORK="ray"
ARG FRAMEWORK_VERSION="2.54.1"
ARG FRAMEWORK_VERSION="2.55.1"
ARG CONTAINER_TYPE="inference"

ARG PYTHON_SHORT_VERSION=3.13
Expand Down
12 changes: 8 additions & 4 deletions docker/ray/Dockerfile.gpu
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,8 +68,12 @@ COPY ./scripts/common/install_python.sh /tmp/install_python.sh
RUN bash /tmp/install_python.sh ${PYTHON_VERSION} && rm /tmp/install_python.sh

# Install pinned dependencies
COPY ./scripts/ray/requirements.lock /tmp/requirements.lock
RUN --mount=type=cache,target=/root/.cache/pip pip install -r /tmp/requirements.lock
COPY --from=ghcr.io/astral-sh/uv:0.11.10 /uv /usr/local/bin/uv
ENV UV_PROJECT_ENVIRONMENT=/usr/local
COPY ./docker/ray/pyproject.toml ./docker/ray/uv.lock /tmp/deps/
RUN --mount=type=cache,target=/root/.cache/uv cd /tmp/deps \
&& uv sync --frozen --no-dev --no-install-project \
&& rm -rf /tmp/deps


#############
Expand All @@ -82,11 +86,11 @@ RUN dnf upgrade -y --security --releasever latest && dnf clean all && rm -rf /va

LABEL maintainer="Amazon AI"
LABEL dlc_major_version="1"
LABEL dlc_minor_version="0"
LABEL dlc_minor_version="1"

ARG PYTHON="python"
ARG FRAMEWORK="ray"
ARG FRAMEWORK_VERSION="2.54.1"
ARG FRAMEWORK_VERSION="2.55.1"
ARG CONTAINER_TYPE="inference"

# Enable video capability to mount NVENC/NVDEC driver libraries
Expand Down
6 changes: 3 additions & 3 deletions scripts/ray/pyproject.toml → docker/ray/pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[project]
name = "dlc-ray"
version = "1.0.0"
version = "1.1.0"
requires-python = "==3.13.*"
dependencies = [
"awscli==1.44.49",
Expand All @@ -13,13 +13,13 @@ dependencies = [
"pandas==3.0.1",
"pillow==12.2.0",
"pyyaml==6.0.3",
"ray[serve]==2.54.1",
"ray[serve]==2.55.1",
"scikit-learn==1.8.0",
"soundfile==0.13.1",
"torch==2.10.0",
"torchaudio==2.10.0",
"torchcodec==0.10.0",
"torchvision==0.25.0",
"transformers==5.2.0",
"transformers==5.8.0",
"uvicorn[standard]==0.41.0",
]
202 changes: 95 additions & 107 deletions scripts/ray/uv.lock → docker/ray/uv.lock
View file
Open in desktop

Large diffs are not rendered by default.

Loading
Loading