Skip to content

Commit 80ca237

Browse files
authored
fix: update the command for Llama Stack server (#2097)
* Update the server run command * testing foreground run * testing foreground run * Update yaml * Update workflow * Update workflow * Update workflow * Update tests * Update toml * Attempt another fix * See what models are available * Increase sleep time * Pin the version
1 parent d83b105 commit 80ca237

2 files changed

Lines changed: 12 additions & 10 deletions

File tree

.github/workflows/llama_stack.yml

Lines changed: 9 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ jobs:
3131
fail-fast: false
3232
matrix:
3333
os: [ubuntu-latest] # to test on other Operating Systems, we need to install Ollama differently
34-
python-version: ["3.10", "3.13"]
34+
python-version: ["3.12", "3.13"]
3535

3636
steps:
3737
- uses: actions/checkout@v4
@@ -77,21 +77,25 @@ jobs:
7777
python-version: ${{ matrix.python-version }}
7878

7979
- name: Test Llama Stack Server
80+
shell: bash
8081
run: |
8182
pip install uv
82-
INFERENCE_MODEL=llama3.2:3b uv run --with llama-stack llama stack build --template ollama --image-type venv --run &
83-
83+
INFERENCE_MODEL=llama3.2:3b uv run --with llama-stack llama stack build --template ollama --image-type venv --run < /dev/null > server.log 2>&1 &
84+
sleep 120
85+
# Verify it's running
86+
curl -f http://localhost:8321/v1/models || { cat server.log; exit 1; }
87+
8488
echo "Llama Stack Server started successfully."
8589
8690
- name: Install Hatch
8791
run: pip install --upgrade hatch
8892

8993
- name: Lint
90-
if: matrix.python-version == '3.10' && runner.os == 'Linux'
94+
if: matrix.python-version == '3.12' && runner.os == 'Linux'
9195
run: hatch run fmt-check && hatch run test:types
9296

9397
- name: Generate docs
94-
if: matrix.python-version == '3.10' && runner.os == 'Linux'
98+
if: matrix.python-version == '3.12' && runner.os == 'Linux'
9599
run: hatch run docs
96100

97101
- name: Run tests

integrations/llama_stack/pyproject.toml

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -7,22 +7,20 @@ name = "llama-stack-haystack"
77
dynamic = ["version"]
88
description = 'Use Llama Stack framework for text generation'
99
readme = "README.md"
10-
requires-python = ">=3.10"
10+
requires-python = ">=3.12"
1111
license = "Apache-2.0"
1212
keywords = []
1313
authors = [{ name = "deepset GmbH", email = "info@deepset.ai" }]
1414
classifiers = [
1515
"License :: OSI Approved :: Apache Software License",
1616
"Development Status :: 4 - Beta",
1717
"Programming Language :: Python",
18-
"Programming Language :: Python :: 3.10", # python 3.9 is not supported by llama-stack
19-
"Programming Language :: Python :: 3.11",
20-
"Programming Language :: Python :: 3.12",
18+
"Programming Language :: Python :: 3.12", # minimum supported version by llama-stack
2119
"Programming Language :: Python :: 3.13",
2220
"Programming Language :: Python :: Implementation :: CPython",
2321
"Programming Language :: Python :: Implementation :: PyPy",
2422
]
25-
dependencies = ["haystack-ai>=2.14", "llama-stack"]
23+
dependencies = ["haystack-ai>=2.14", "llama-stack==0.2.14"]
2624

2725
[project.urls]
2826
Documentation = "https://github.com/deepset-ai/haystack-core-integrations/tree/main/integrations/llama-stack#readme"

0 commit comments

Comments
 (0)