Commit d92014a
committed
drop LocalAI from default stack + dashboard polish
Operator directive 2026-05-11: 'docker.io/localai/localai:v2.20.0
07f03c3494ad 31.9 GB ... we don't need these components'. Disable
mios-ai by default and point Hermes' auxiliary (compression /
summarization) at Ollama instead of LocalAI -- one less daemon to
keep alive, ~32 GB less image storage, no functional loss because
Ollama serves the same /v1 surface and the same qwen3.5:2b model
that the primary chat backend uses.
mios.toml [quadlets.enable]:
mios-ai = false # was true; opt-in via /etc/mios/mios.toml for
# embeddings / image-gen / STT-TTS sidecars
hermes/config.yaml auxiliary:
base_url: http://mios-ai:8080/v1 -> http://mios-ollama:11434/v1
api_key: ${API_SERVER_KEY} -> ""
(Ollama's /v1 accepts unauthenticated localhost; no shared secret
needed for the loopback path. mios-ai stays in-tree as an opt-in
sidecar -- aux can be repointed at it by an operator override
under /etc/mios/hermes/config.local.yaml.)
mios-dashboard.sh:
* AI line removed -- Ollama line gains the model annotation. The
dashboard now shows the canonical chain (Ollama -> Hermes ->
Workspace) without the redundant LocalAI URL.
* Hermes status probe -> /health (no-auth 200) instead of
/v1/models (which returns 401 without the API_SERVER_KEY
bearer; ep_dot's naive curl read that as DOWN every refresh).
* 'WebUI' label -> 'Workspace' on port 3030 (the workspace owns
that port now; Open WebUI moves to 3031 if re-enabled).
* mios-hermes-workspace added to the Quadlet services list.
* MIOS_AI_MODEL default qwen2.5-coder:7b -> qwen3.5:2b (matches
mios.toml [ai].model from commit 95471ae).1 parent b60e975 commit d92014a
3 files changed
Lines changed: 34 additions & 15 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
183 | 183 | | |
184 | 184 | | |
185 | 185 | | |
186 | | - | |
| 186 | + | |
187 | 187 | | |
188 | 188 | | |
189 | 189 | | |
| |||
315 | 315 | | |
316 | 316 | | |
317 | 317 | | |
318 | | - | |
319 | | - | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
320 | 325 | | |
321 | 326 | | |
322 | 327 | | |
323 | | - | |
324 | | - | |
325 | 328 | | |
326 | 329 | | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
327 | 333 | | |
328 | | - | |
329 | | - | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
330 | 340 | | |
331 | 341 | | |
332 | 342 | | |
| |||
335 | 345 | | |
336 | 346 | | |
337 | 347 | | |
338 | | - | |
| 348 | + | |
339 | 349 | | |
340 | 350 | | |
341 | 351 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
37 | 39 | | |
38 | 40 | | |
39 | | - | |
| 41 | + | |
40 | 42 | | |
41 | | - | |
| 43 | + | |
42 | 44 | | |
43 | 45 | | |
44 | 46 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2170 | 2170 | | |
2171 | 2171 | | |
2172 | 2172 | | |
2173 | | - | |
| 2173 | + | |
| 2174 | + | |
| 2175 | + | |
| 2176 | + | |
| 2177 | + | |
| 2178 | + | |
| 2179 | + | |
| 2180 | + | |
2174 | 2181 | | |
2175 | 2182 | | |
2176 | 2183 | | |
| |||
0 commit comments