Skip to content

Commit 1280ea0

Browse files
Kabuki94claude
andcommitted
hermes config.yaml: add auxiliary LLM block pointing at mios-ai
Operator-flagged 2026-05-11 (inside the mios-hermes container shell after running setup-hermes.sh): every agent invocation logs WARNING agent.auxiliary_client: Auxiliary auto-detect: no provider available (tried: openrouter, nous, local/custom, api-key) Compression, summarization, and memory flush will not work. Set OPENROUTER_API_KEY or configure a local model in config.yaml. Hermes-Agent has two model slots: * `backend` -- the operator-facing chat model (already wired here to mios-ollama:11434 / qwen2.5-coder:7b) * `auxiliary` -- a separate model used for context compression, summarization, and memory flush. With no config block Hermes falls through openrouter/nous/local-custom/api-key and lands on nothing, so those features silently degrade. Added an `auxiliary` block pointing at the same mios-ai (LocalAI OpenAI-compatible /v1) surface every other MiOS AI client uses (Architectural Law 5). Reuses the API_SERVER_KEY from /etc/mios/hermes/api.env so we don't ship a second secret. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1 parent 1a73021 commit 1280ea0

1 file changed

Lines changed: 16 additions & 0 deletions

File tree

usr/share/mios/hermes/config.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,22 @@ backend:
2424
- qwen2.5-coder:7b
2525
- nomic-embed-text
2626

27+
# Auxiliary LLM -- Hermes uses this for context compression,
28+
# summarization, and memory flush (separate from the main backend
29+
# that handles the operator-facing chat). Without it Hermes logs:
30+
# Auxiliary auto-detect: no provider available
31+
# (tried: openrouter, nous, local/custom, api-key)
32+
# and silently degrades (compression drops middle turns without a
33+
# summary, memory flush no-ops). Point it at the same mios-ai
34+
# (LocalAI OpenAI-compatible /v1) surface the rest of MiOS uses
35+
# so the agent stays 100% local-stack by default. API key reused
36+
# from /etc/mios/hermes/api.env so we don't add another secret.
37+
auxiliary:
38+
provider: local/custom
39+
base_url: http://mios-ai:8080/v1
40+
model: qwen2.5-coder:7b
41+
api_key: ${API_SERVER_KEY}
42+
2743
api_server:
2844
# Bind / port / key / cors values come from the EnvironmentFile=
2945
# /etc/mios/hermes/api.env in the Quadlet. They're listed here as

0 commit comments

Comments
 (0)