@@ -140,6 +140,60 @@ embedding:
140140/model # Show current model
141141```
142142
143+ ## Auxiliary Models (Task-Specific Models)
144+
145+ Hermes supports dedicated models for eight task types. Each can have its own provider, model, base_url, api_key, and timeout.
146+
147+ | Task Type | What It Does | Default |
148+ | -----------| -------------| ---------|
149+ | ` vision ` | Image analysis, screenshot understanding | auto |
150+ | ` web_extract ` | Summarizing scraped web pages | auto |
151+ | ` compression ` | Context compression (summarizing old messages) | auto |
152+ | ` session_search ` | Searching past conversation transcripts | auto |
153+ | ` approval ` | Deciding whether to auto-approve tool calls | auto |
154+ | ` skills_hub ` | Skill discovery and matching | auto |
155+ | ` mcp ` | MCP tool routing | auto |
156+ | ` flush_memories ` | Memory consolidation and cleanup | auto |
157+
158+ When set to ` "auto" ` (default), Hermes walks a provider resolution chain: OpenRouter → Nous Portal → Custom endpoint → etc.
159+
160+ ** Configure in ` ~/.hermes/config.yaml ` :**
161+
162+ ``` yaml
163+ auxiliary_models :
164+ # Use a fast cheap model for compression — it's just summarizing
165+ compression :
166+ provider : cerebras
167+ model : llama-3.3-70b
168+ timeout : 30
169+
170+ # Use a vision-capable model for image analysis
171+ vision :
172+ provider : openrouter
173+ model : google/gemini-2.5-flash
174+ timeout : 60
175+
176+ # Use local model for session search (free, frequent calls)
177+ session_search :
178+ provider : local
179+ model : nemotron:latest
180+ base_url : http://localhost:11434/v1
181+ api_key : ollama
182+
183+ # Everything else stays on auto
184+ web_extract : auto
185+ approval : auto
186+ skills_hub : auto
187+ mcp : auto
188+ flush_memories : auto
189+ ` ` `
190+
191+ **Why bother:**
192+ - **Compression** runs on every long session. Using a cheap/fast model saves money without affecting quality (summarization doesn't need Opus).
193+ - **Vision** needs a multimodal model. If your main model doesn't do images, set this to one that does.
194+ - **Session search** is called frequently. A local model makes it free.
195+ - **Approval** controls auto-execution. A fast model here means less latency on every tool call.
196+
143197## Fallback Chain
144198
145199Configure automatic fallback if the primary model fails:
0 commit comments