Skip to content

Commit 69cc13e

Browse files
torimwhaleyclaude
andcommitted
Add LiteLLM / OpenAI-compatible proxy docs to AI config
Document how to use OpenAI-compatible proxies like LiteLLM with Lightdash AI Analyst by pointing OPENAI_BASE_URL at the proxy endpoint. This has come up from multiple customers (Pylon #10882). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 5b7df55 commit 69cc13e

1 file changed

Lines changed: 15 additions & 0 deletions

File tree

self-host/customize-deployment/environment-variables.mdx

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,21 @@ To enable AI Analyst, set `AI_COPILOT_ENABLED=true` and provide an API key for `
253253
| `OPENAI_BASE_URL` | Optional base URL for OpenAI compatible API |
254254
| `OPENAI_AVAILABLE_MODELS` | Comma-separated list of models available in the model picker (default=All supported models) |
255255

256+
<Tip>
257+
**Using an OpenAI-compatible proxy (e.g. LiteLLM)**
258+
259+
If your organization uses an OpenAI-compatible proxy like [LiteLLM](https://www.litellm.ai/), you can connect it to Lightdash by setting `AI_DEFAULT_PROVIDER=openai` and pointing `OPENAI_BASE_URL` to your proxy URL. For example:
260+
261+
- `AI_DEFAULT_PROVIDER=openai`
262+
- `OPENAI_API_KEY=<your-proxy-api-key>`
263+
- `OPENAI_BASE_URL=<your-proxy-url>`
264+
- `OPENAI_MODEL_NAME=<model-name-configured-in-your-proxy>`
265+
266+
Make sure your proxy has the model names correctly mapped. For example, if you set `OPENAI_MODEL_NAME=gpt-4o`, your proxy needs to have that model routed to whatever underlying provider you're using. The same applies for the embedding model.
267+
268+
If you want to expose multiple models through the proxy, use `OPENAI_AVAILABLE_MODELS` with a comma-separated list of model names.
269+
</Tip>
270+
256271
#### Anthropic Configuration
257272

258273
| Variable | Description |

0 commit comments

Comments
 (0)