Skip to content

Commit 68dcccd

Browse files
authored
chore(readme): update config/scaling docs (#249)
Signed-off-by: Anupam Kumar <kyteinsky@gmail.com>
1 parent 6ad9d27 commit 68dcccd

1 file changed

Lines changed: 2 additions & 6 deletions

File tree

README.md

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -116,12 +116,8 @@ Make sure to restart the app after changing the config file. For docker, this wo
116116

117117
This is a file copied from one of the two configurations (config.cpu.yaml or config.gpu.conf) during app startup if `config.yaml` is not already present to the persistent storage. See [Repair section](#repair) on details on the repair step that removes the config if you have a custom config.
118118

119-
The default way is to spawn an embedding server backed by llama.cpp, where the local model runs on either CPU or GPU. The other option is to use a remote model from a OpenAI-compatible API. The configuration for the remote model is also present in the sample config files.
120-
API key or username/password for the remote API can be stored in the config file itself or environment variables can be used. `CCB_EM_APIKEY` for the API key and `CCB_EM_USERNAME` and `CCB_EM_PASSWORD` for the username and password respectively.
121-
To indicate the use of environment variables, set the value of `auth` in the config file to `from_env`, like so:
122-
```yaml
123-
auth: from_env
124-
```
119+
The default way is to spawn an embedding server backed by llama.cpp, where the local model runs on either CPU or GPU. The other option is to use a remote model from a OpenAI-compatible API.
120+
The configuration for the remote model can be done in the `embedding` section of the config file or environment variables can be set during the deployment of the app. The environment variables override the config. See the [Scaling section](https://docs.nextcloud.com/server/latest/admin_manual/ai/app_context_chat.html#scaling) in the admin docs for more details.
125121

126122
## Repair
127123
v2.1.0 introduces repair steps. These run on app startup.

0 commit comments

Comments
 (0)