You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-6Lines changed: 2 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -116,12 +116,8 @@ Make sure to restart the app after changing the config file. For docker, this wo
116
116
117
117
This is a file copied from one of the two configurations (config.cpu.yaml or config.gpu.conf) during app startup if `config.yaml` is not already present to the persistent storage. See [Repair section](#repair) on details on the repair step that removes the config if you have a custom config.
118
118
119
-
The default way is to spawn an embedding server backed by llama.cpp, where the local model runs on either CPU or GPU. The other option is to use a remote model from a OpenAI-compatible API. The configuration for the remote model is also present in the sample config files.
120
-
API key or username/password for the remote API can be stored in the config file itself or environment variables can be used. `CCB_EM_APIKEY` for the API key and `CCB_EM_USERNAME` and `CCB_EM_PASSWORD` for the username and password respectively.
121
-
To indicate the use of environment variables, set the value of `auth` in the config file to `from_env`, like so:
122
-
```yaml
123
-
auth: from_env
124
-
```
119
+
The default way is to spawn an embedding server backed by llama.cpp, where the local model runs on either CPU or GPU. The other option is to use a remote model from a OpenAI-compatible API.
120
+
The configuration for the remote model can be done in the `embedding` section of the config file or environment variables can be set during the deployment of the app. The environment variables override the config. See the [Scaling section](https://docs.nextcloud.com/server/latest/admin_manual/ai/app_context_chat.html#scaling) in the admin docs for more details.
125
121
126
122
## Repair
127
123
v2.1.0 introduces repair steps. These run on app startup.
0 commit comments