Skip to content

Commit c5a310b

Browse files
committed
docs: improve music generation docs
1 parent f4ffac6 commit c5a310b

3 files changed

Lines changed: 43 additions & 2 deletions

File tree

docs/help/testing.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -422,6 +422,19 @@ If you want to rely on env keys (e.g. exported in your `~/.profile`), run local
422422
- Optional auth behavior:
423423
- `OPENCLAW_LIVE_REQUIRE_PROFILE_KEYS=1` to force profile-store auth and ignore env-only overrides
424424

425+
## Music generation live
426+
427+
- Test: `extensions/music-generation-providers.live.test.ts`
428+
- Enable: `OPENCLAW_LIVE_TEST=1 pnpm test:live -- extensions/music-generation-providers.live.test.ts`
429+
- Scope:
430+
- Exercises the shared bundled music-generation provider path
431+
- Currently covers Google and MiniMax
432+
- Loads provider env vars from your login shell (`~/.profile`) before probing
433+
- Skips providers with no usable auth/profile/model
434+
- Optional narrowing:
435+
- `OPENCLAW_LIVE_MUSIC_GENERATION_PROVIDERS="google,minimax"`
436+
- `OPENCLAW_LIVE_MUSIC_GENERATION_MODELS="google/lyria-3-clip-preview,minimax/music-2.5+"`
437+
425438
## Docker runners (optional "works in Linux" checks)
426439

427440
These Docker runners split into two buckets:

docs/tools/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -106,7 +106,7 @@ Plugins can register additional tools. Some examples:
106106

107107
- [Lobster](/tools/lobster) — typed workflow runtime with resumable approvals
108108
- [LLM Task](/tools/llm-task) — JSON-only LLM step for structured output
109-
- [Music Generation](/tools/music-generation)plugin-provided `music_generate` tool surfaces
109+
- [Music Generation](/tools/music-generation)shared `music_generate` tool plus plugin-provided workflow variants
110110
- [Diffs](/tools/diffs) — diff viewer and renderer
111111
- [OpenProse](/prose) — markdown-first workflow orchestration
112112

docs/tools/music-generation.md

Lines changed: 29 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,6 +56,16 @@ For direct synchronous contexts without a session-backed agent run, the built-in
5656
tool still falls back to inline generation and returns the final media path in
5757
the tool result.
5858

59+
Example prompts:
60+
61+
```text
62+
Generate a cinematic piano track with soft strings and no vocals.
63+
```
64+
65+
```text
66+
Generate an energetic chiptune loop about launching a rocket at sunrise.
67+
```
68+
5969
### Workflow-driven plugin generation
6070

6171
The bundled `comfy` plugin can also provide `music_generate` using a
@@ -92,13 +102,25 @@ runtime:
92102
/tool music_generate action=list
93103
```
94104

105+
Use `action: "status"` to inspect the active session-backed music task:
106+
107+
```text
108+
/tool music_generate action=status
109+
```
110+
111+
Direct generation example:
112+
113+
```text
114+
/tool music_generate prompt="Dreamy lo-fi hip hop with vinyl texture and gentle rain" instrumental=true
115+
```
116+
95117
## Built-in tool parameters
96118

97119
| Parameter | Type | Description |
98120
| ----------------- | -------- | ------------------------------------------------------------------------------------------------- |
99121
| `prompt` | string | Music generation prompt (required for `action: "generate"`) |
100122
| `action` | string | `"generate"` (default), `"status"` for the current session task, or `"list"` to inspect providers |
101-
| `model` | string | Provider/model override, e.g. `google/lyria-3-pro-preview` or `comfy/workflow` |
123+
| `model` | string | Provider/model override, e.g. `google/lyria-3-pro-preview` or `comfy/workflow` |
102124
| `lyrics` | string | Optional lyrics when the provider supports explicit lyric input |
103125
| `instrumental` | boolean | Request instrumental-only output when the provider supports it |
104126
| `image` | string | Single reference image path or URL |
@@ -161,6 +183,12 @@ error includes details from each attempt.
161183
- ComfyUI support is workflow-driven and depends on the configured graph plus
162184
node mapping for prompt/output fields.
163185

186+
## Choosing the right path
187+
188+
- Use the shared provider-backed path when you want model selection, provider failover, and the built-in async task/status flow.
189+
- Use a plugin path such as ComfyUI when you need a custom workflow graph or a provider that is not part of the shared bundled music capability.
190+
- If you are debugging ComfyUI-specific behavior, see [ComfyUI](/providers/comfy). If you are debugging shared provider behavior, start with [Google (Gemini)](/providers/google) or [MiniMax](/providers/minimax).
191+
164192
## Live tests
165193

166194
Opt-in live coverage for the shared bundled providers:

0 commit comments

Comments
 (0)