Skip to content

Commit 53459f9

Browse files
committed
Add extra providers
1 parent 730ad1e commit 53459f9

1 file changed

Lines changed: 45 additions & 0 deletions

File tree

content/docs/features/providers.mdx

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,51 @@ llms --update-providers
3333

3434
As an optimization, only providers referenced in your `llms.json` are saved locally, keeping your configuration lightweight.
3535

36+
### Extra Providers
37+
38+
Any additional providers you want to use that are not included in models.dev can be added to your `~/.llms/providers-extra.json`, which get merged into your `providers.json` on every update. This keeps your local configuration file lightweight by only including the providers that are available for use.
39+
40+
This is used in the default [providers-extra.json](https://github.com/ServiceStack/llms/blob/main/llms/providers-extra.json) for image generation providers which are not yet supported in models.dev, e.g:
41+
42+
```json
43+
{
44+
"chutes": {
45+
"models": {
46+
"chutes-z-image-turbo": {
47+
"name": "Z Image Turbo",
48+
"modalities": {
49+
"input": [
50+
"text"
51+
],
52+
"output": [
53+
"image"
54+
]
55+
}
56+
}
57+
}
58+
},
59+
"zai": {
60+
"models": {
61+
"glm-image": {
62+
"name": "GLM-Image",
63+
"modalities": {
64+
"input": [
65+
"text"
66+
],
67+
"output": [
68+
"image"
69+
]
70+
},
71+
"cost": {
72+
"input": 0,
73+
"output": 0.015
74+
}
75+
}
76+
}
77+
}
78+
}
79+
```
80+
3681
---
3782

3883
## Supported Providers

0 commit comments

Comments
 (0)