Skip to content

Commit ef8034a

Browse files
committed
Add auxiliary models section — task-specific model configuration
1 parent 27ab85f commit ef8034a

1 file changed

Lines changed: 54 additions & 0 deletions

File tree

part9-custom-models.md

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -140,6 +140,60 @@ embedding:
140140
/model # Show current model
141141
```
142142

143+
## Auxiliary Models (Task-Specific Models)
144+
145+
Hermes supports dedicated models for eight task types. Each can have its own provider, model, base_url, api_key, and timeout.
146+
147+
| Task Type | What It Does | Default |
148+
|-----------|-------------|---------|
149+
| `vision` | Image analysis, screenshot understanding | auto |
150+
| `web_extract` | Summarizing scraped web pages | auto |
151+
| `compression` | Context compression (summarizing old messages) | auto |
152+
| `session_search` | Searching past conversation transcripts | auto |
153+
| `approval` | Deciding whether to auto-approve tool calls | auto |
154+
| `skills_hub` | Skill discovery and matching | auto |
155+
| `mcp` | MCP tool routing | auto |
156+
| `flush_memories` | Memory consolidation and cleanup | auto |
157+
158+
When set to `"auto"` (default), Hermes walks a provider resolution chain: OpenRouter → Nous Portal → Custom endpoint → etc.
159+
160+
**Configure in `~/.hermes/config.yaml`:**
161+
162+
```yaml
163+
auxiliary_models:
164+
# Use a fast cheap model for compression — it's just summarizing
165+
compression:
166+
provider: cerebras
167+
model: llama-3.3-70b
168+
timeout: 30
169+
170+
# Use a vision-capable model for image analysis
171+
vision:
172+
provider: openrouter
173+
model: google/gemini-2.5-flash
174+
timeout: 60
175+
176+
# Use local model for session search (free, frequent calls)
177+
session_search:
178+
provider: local
179+
model: nemotron:latest
180+
base_url: http://localhost:11434/v1
181+
api_key: ollama
182+
183+
# Everything else stays on auto
184+
web_extract: auto
185+
approval: auto
186+
skills_hub: auto
187+
mcp: auto
188+
flush_memories: auto
189+
```
190+
191+
**Why bother:**
192+
- **Compression** runs on every long session. Using a cheap/fast model saves money without affecting quality (summarization doesn't need Opus).
193+
- **Vision** needs a multimodal model. If your main model doesn't do images, set this to one that does.
194+
- **Session search** is called frequently. A local model makes it free.
195+
- **Approval** controls auto-execution. A fast model here means less latency on every tool call.
196+
143197
## Fallback Chain
144198
145199
Configure automatic fallback if the primary model fails:

0 commit comments

Comments
 (0)