Skip to content

Commit 053e01d

Browse files
ci : added kleidiai-server to server-self-hosted workflow (ggml-org#22435)
* kleidiai: added kleidiai-server to server-self-hosted workflow * Added KleidiAI-enabled Arm64 Linux llama-server CI/integration test workflow into the server-self-hosted.yml configuration file Signed-off-by: Martin Klacer <martin.klacer@arm.com> Change-Id: I032e33c525b7e26bc5d53719f638bee610cec1ee * Added self-hosted executor for KleidiAI server workflow Signed-off-by: Martin Klacer <martin.klacer@arm.com> * Update .github/workflows/server-self-hosted.yml Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> --------- Signed-off-by: Martin Klacer <martin.klacer@arm.com> Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
1 parent c3f95c1 commit 053e01d

1 file changed

Lines changed: 38 additions & 0 deletions

File tree

.github/workflows/server-self-hosted.yml

Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -130,3 +130,41 @@ jobs:
130130
# pip install -r requirements.txt
131131
# export ${{ matrix.extra_args }}
132132
# pytest -v -x -m "not slow"
133+
134+
server-kleidiai:
135+
runs-on: ah-ubuntu_22_04-c8g_8x
136+
137+
name: server-kleidiai (${{ matrix.wf_name }})
138+
strategy:
139+
matrix:
140+
include:
141+
- build_type: Release
142+
extra_build_flags: "-DGGML_CPU_KLEIDIAI=ON"
143+
extra_args: ""
144+
wf_name: "CPUx1, kleidiai"
145+
fail-fast: false
146+
147+
steps:
148+
- name: Clone
149+
id: checkout
150+
uses: actions/checkout@v6
151+
with:
152+
fetch-depth: 0
153+
ref: ${{ github.event.inputs.sha || github.event.pull_request.head.sha || github.sha || github.head_ref || github.ref_name }}
154+
155+
- name: Build
156+
id: cmake_build
157+
run: |
158+
cmake -B build -DGGML_SCHED_NO_REALLOC=ON ${{ matrix.extra_build_flags }}
159+
cmake --build build --config ${{ matrix.build_type }} -j $(nproc) --target llama-server
160+
161+
- name: Tests
162+
id: server_integration_tests
163+
if: ${{ (!matrix.disabled_on_pr || !github.event.pull_request) }}
164+
run: |
165+
cd tools/server/tests
166+
python3 -m venv venv
167+
source venv/bin/activate
168+
pip install -r requirements.txt
169+
export ${{ matrix.extra_args }}
170+
pytest -v -x -m "not slow"

0 commit comments

Comments
 (0)