You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+8-4Lines changed: 8 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2945,12 +2945,15 @@ docker run --rm \
2945
2945
2946
2946
#### Using Pre-configured Providers
2947
2947
2948
-
The Docker image comes with built-in support for major providers (OpenAI, Anthropic, Gemini, Ollama) and pre-configured provider files for additional services (OpenRouter, DeepInfra, DeepSeek, Moonshot, Novita):
2948
+
The Docker image comes with built-in support for major providers (OpenAI, Anthropic, Gemini, Ollama) and pre-configured provider files for additional services (OpenRouter, OrcaRouter, DeepInfra, DeepSeek, Moonshot, Novita):
To use these configurations, your `.env` file only needs to contain:
3004
3007
3005
3008
```
3006
-
LLM_SERVER_URL=https://openrouter.ai/api/v1 # or https://api.deepinfra.com/v1/openai or https://api.openai.com/v1 or https://api.novita.ai/openai
3009
+
LLM_SERVER_URL=https://openrouter.ai/api/v1 # or https://api.orcarouter.ai/v1 or https://api.deepinfra.com/v1/openai or https://api.openai.com/v1 or https://api.novita.ai/openai
3007
3010
LLM_SERVER_KEY=your_api_key
3008
3011
LLM_SERVER_MODEL= # Leave empty, as models are specified in the config
3009
-
LLM_SERVER_CONFIG_PATH=/opt/pentagi/conf/openrouter.provider.yml # or deepinfra.provider.ymll or custom-openai.provider.yml or novita.provider.yml
3010
-
LLM_SERVER_PROVIDER= # Provider name for LiteLLM proxy (e.g., openrouter, deepseek, moonshot, novita)
3012
+
LLM_SERVER_CONFIG_PATH=/opt/pentagi/conf/openrouter.provider.yml # or orcarouter.provider.yml or deepinfra.provider.ymll or custom-openai.provider.yml or novita.provider.yml
3013
+
LLM_SERVER_PROVIDER= # Provider name for LiteLLM proxy (e.g., openrouter, orcarouter, deepseek, moonshot, novita)
3011
3014
LLM_SERVER_LEGACY_REASONING=false # Controls reasoning format, for OpenAI must be true (default: false)
3012
3015
LLM_SERVER_PRESERVE_REASONING=false # Preserve reasoning content in multi-turn conversations (required by Moonshot, default: false)
3013
3016
@@ -3127,6 +3130,7 @@ When using LiteLLM proxy, set the corresponding `*_PROVIDER` variable to enable
3127
3130
-`dashscope` - for Qwen models (`QWEN_PROVIDER=dashscope` → `dashscope/qwen-plus`)
3128
3131
-`openai`, `anthropic`, `gemini` - for major cloud providers
3129
3132
-`openrouter` - for OpenRouter aggregator
3133
+
-`orcarouter` - for OrcaRouter aggregator
3130
3134
-`deepinfra` - for DeepInfra hosting
3131
3135
-`novita` - for Novita AI
3132
3136
- Any other provider name configured in your LiteLLM instance
0 commit comments