Skip to content

Commit 60facc7

Browse files
localai-botmudler
andauthored
fix(darwin): publish sherpa-onnx and speaker-recognition images for darwin/arm64 (#10275)
Neither the sherpa-onnx nor the speaker-recognition backend had a darwin/arm64 image, so `local-ai backends install` failed with "no child with platform darwin/arm64" on macOS. This left /v1/audio/diarization (the sherpa-onnx path) and /v1/voice/embed without any usable backend on Apple Silicon. Both backends build on darwin/arm64: - sherpa-onnx (Go) already fetches the onnxruntime osx-arm64 runtime in its Makefile; it only needed a darwin matrix entry (build-type metal, lang go, like whisper and silero-vad). - speaker-recognition (Python) needed a requirements-mps.txt so the mps build installs plain onnxruntime (which ships a macOS arm64 wheel) instead of the onnxruntime-gpu pulled by its base requirements (which does not). Add both to the includeDarwin build matrix, wire the metal capability and metal image aliases into the gallery, and add the speaker-recognition requirements-mps.txt. Fixes #10268 Assisted-by: Claude:claude-opus-4-8 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 8c8204d commit 60facc7

3 files changed

Lines changed: 36 additions & 0 deletions

File tree

.github/backend-matrix.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4461,10 +4461,17 @@ includeDarwin:
44614461
tag-suffix: "-metal-darwin-arm64-silero-vad"
44624462
build-type: "metal"
44634463
lang: "go"
4464+
- backend: "sherpa-onnx"
4465+
tag-suffix: "-metal-darwin-arm64-sherpa-onnx"
4466+
build-type: "metal"
4467+
lang: "go"
44644468
- backend: "local-store"
44654469
tag-suffix: "-metal-darwin-arm64-local-store"
44664470
build-type: "metal"
44674471
lang: "go"
44684472
- backend: "llama-cpp-quantization"
44694473
tag-suffix: "-metal-darwin-arm64-llama-cpp-quantization"
44704474
build-type: "mps"
4475+
- backend: "speaker-recognition"
4476+
tag-suffix: "-metal-darwin-arm64-speaker-recognition"
4477+
build-type: "mps"

backend/index.yaml

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1254,6 +1254,7 @@
12541254
default: "cpu-sherpa-onnx"
12551255
nvidia: "cuda12-sherpa-onnx"
12561256
nvidia-cuda-12: "cuda12-sherpa-onnx"
1257+
metal: "metal-sherpa-onnx"
12571258
- !!merge <<: *neutts
12581259
name: "neutts-development"
12591260
capabilities:
@@ -4716,12 +4717,14 @@
47164717
default: "cpu-speaker-recognition"
47174718
nvidia: "cuda12-speaker-recognition"
47184719
nvidia-cuda-12: "cuda12-speaker-recognition"
4720+
metal: "metal-speaker-recognition"
47194721
- !!merge <<: *speakerrecognition
47204722
name: "speaker-recognition-development"
47214723
capabilities:
47224724
default: "cpu-speaker-recognition-development"
47234725
nvidia: "cuda12-speaker-recognition-development"
47244726
nvidia-cuda-12: "cuda12-speaker-recognition-development"
4727+
metal: "metal-speaker-recognition-development"
47254728
- !!merge <<: *speakerrecognition
47264729
name: "cpu-speaker-recognition"
47274730
uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-speaker-recognition"
@@ -4742,13 +4745,24 @@
47424745
uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-speaker-recognition"
47434746
mirrors:
47444747
- localai/localai-backends:master-gpu-nvidia-cuda-12-speaker-recognition
4748+
- !!merge <<: *speakerrecognition
4749+
name: "metal-speaker-recognition"
4750+
uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-speaker-recognition"
4751+
mirrors:
4752+
- localai/localai-backends:latest-metal-darwin-arm64-speaker-recognition
4753+
- !!merge <<: *speakerrecognition
4754+
name: "metal-speaker-recognition-development"
4755+
uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-speaker-recognition"
4756+
mirrors:
4757+
- localai/localai-backends:master-metal-darwin-arm64-speaker-recognition
47454758
## sherpa-onnx
47464759
- !!merge <<: *sherpa-onnx
47474760
name: "sherpa-onnx-development"
47484761
capabilities:
47494762
default: "cpu-sherpa-onnx-development"
47504763
nvidia: "cuda12-sherpa-onnx-development"
47514764
nvidia-cuda-12: "cuda12-sherpa-onnx-development"
4765+
metal: "metal-sherpa-onnx-development"
47524766
- !!merge <<: *sherpa-onnx
47534767
name: "cpu-sherpa-onnx"
47544768
uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sherpa-onnx"
@@ -4769,3 +4783,13 @@
47694783
uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx"
47704784
mirrors:
47714785
- localai/localai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx
4786+
- !!merge <<: *sherpa-onnx
4787+
name: "metal-sherpa-onnx"
4788+
uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sherpa-onnx"
4789+
mirrors:
4790+
- localai/localai-backends:latest-metal-darwin-arm64-sherpa-onnx
4791+
- !!merge <<: *sherpa-onnx
4792+
name: "metal-sherpa-onnx-development"
4793+
uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sherpa-onnx"
4794+
mirrors:
4795+
- localai/localai-backends:master-metal-darwin-arm64-sherpa-onnx
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
torch
2+
torchaudio
3+
speechbrain
4+
transformers
5+
onnxruntime

0 commit comments

Comments
 (0)