Skip to content

Commit da6a5cf

Browse files
committed
LCORE-1872: Fix llama-stack container startup issues
Fixes two issues preventing llama-stack container from starting: 1. SQLite compatibility error - Switch base image from ubi9/ubi-minimal to ubi9/python-312. The minimal image ships with SQLite < 3.30.0 which lacks sqlite3_deserialize support required by Python 3.12's _sqlite3 module. The python-312 base image includes a compatible SQLite version and properly configured Python dependencies. 2. Read-only filesystem error - Config enrichment script now writes to /tmp/enriched-run.yaml instead of /opt/app-root/run.yaml. The latter is mounted read-only from the host, causing OSError when the enrichment script attempts to write the enriched configuration. Signed-off-by: Anik Bhattacharjee <anbhatta@redhat.com>
1 parent bd6e112 commit da6a5cf

4 files changed

Lines changed: 9 additions & 8 deletions

File tree

deploy/llama-stack/test.containerfile

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,12 @@
1-
# Upstream llama-stack built from Red Hat UBI
2-
FROM registry.access.redhat.com/ubi9/ubi-minimal
1+
# Upstream llama-stack built from Red Hat UBI Python 3.12 image
2+
FROM registry.access.redhat.com/ubi9/python-312
33

44
USER root
55

6-
# Install Python and build tools
7-
RUN microdnf install -y --nodocs --setopt=keepcache=0 --setopt=tsflags=nodocs \
8-
python3.12 python3.12-devel python3.12-pip git tar gcc gcc-c++ make
6+
# Install additional build tools
7+
RUN dnf install -y --nodocs --setopt=keepcache=0 --setopt=tsflags=nodocs \
8+
git tar gcc gcc-c++ make && \
9+
dnf clean all
910

1011
# Install uv
1112
ENV PATH="/root/.local/bin:${PATH}"

scripts/llama-stack-entrypoint.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55
set -e
66

77
INPUT_CONFIG="${LLAMA_STACK_CONFIG:-/opt/app-root/run.yaml}"
8-
ENRICHED_CONFIG="/opt/app-root/run.yaml"
8+
ENRICHED_CONFIG="/tmp/enriched-run.yaml"
99
LIGHTSPEED_CONFIG="${LIGHTSPEED_CONFIG:-/opt/app-root/lightspeed-stack.yaml}"
1010

1111
# Enrich config if lightspeed config exists

tests/e2e-prow/rhoai/manifests/lightspeed/llama-stack-openai.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -152,7 +152,7 @@ spec:
152152
}
153153
restore_rag_seed
154154
INPUT_CONFIG="${LLAMA_STACK_CONFIG:-/opt/app-root/run.yaml}"
155-
ENRICHED_CONFIG="/opt/app-root/run.yaml"
155+
ENRICHED_CONFIG="/tmp/enriched-run.yaml"
156156
LIGHTSPEED_CONFIG="${LIGHTSPEED_CONFIG:-/opt/app-root/lightspeed-stack.yaml}"
157157
if [[ -f "$LIGHTSPEED_CONFIG" ]]; then
158158
echo "Enriching llama-stack config..."

tests/e2e-prow/rhoai/manifests/lightspeed/llama-stack-prow.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -142,7 +142,7 @@ spec:
142142
}
143143
restore_rag_seed
144144
INPUT_CONFIG="${LLAMA_STACK_CONFIG:-/opt/app-root/run.yaml}"
145-
ENRICHED_CONFIG="/opt/app-root/run.yaml"
145+
ENRICHED_CONFIG="/tmp/enriched-run.yaml"
146146
LIGHTSPEED_CONFIG="${LIGHTSPEED_CONFIG:-/opt/app-root/lightspeed-stack.yaml}"
147147
if [[ -f "$LIGHTSPEED_CONFIG" ]]; then
148148
echo "Enriching llama-stack config..."

0 commit comments

Comments
 (0)