Skip to content

Commit c95cc77

Browse files
authored
Merge pull request #362 from jinhaosong-source/feat/orcarouter-provider-config
Add OrcaRouter pre-configured provider
2 parents d93d45b + 2abeecb commit c95cc77

2 files changed

Lines changed: 142 additions & 4 deletions

File tree

README.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2945,12 +2945,15 @@ docker run --rm \
29452945

29462946
#### Using Pre-configured Providers
29472947

2948-
The Docker image comes with built-in support for major providers (OpenAI, Anthropic, Gemini, Ollama) and pre-configured provider files for additional services (OpenRouter, DeepInfra, DeepSeek, Moonshot, Novita):
2948+
The Docker image comes with built-in support for major providers (OpenAI, Anthropic, Gemini, Ollama) and pre-configured provider files for additional services (OpenRouter, OrcaRouter, DeepInfra, DeepSeek, Moonshot, Novita):
29492949

29502950
```bash
29512951
# Test with OpenRouter configuration
29522952
docker exec -it pentagi /opt/pentagi/bin/ctester -config /opt/pentagi/conf/openrouter.provider.yml
29532953

2954+
# Test with OrcaRouter configuration
2955+
docker exec -it pentagi /opt/pentagi/bin/ctester -config /opt/pentagi/conf/orcarouter.provider.yml
2956+
29542957
# Test with DeepInfra configuration
29552958
docker exec -it pentagi /opt/pentagi/bin/ctester -config /opt/pentagi/conf/deepinfra.provider.yml
29562959

@@ -3003,11 +3006,11 @@ docker exec -it pentagi /opt/pentagi/bin/ctester -config /opt/pentagi/conf/ollam
30033006
To use these configurations, your `.env` file only needs to contain:
30043007

30053008
```
3006-
LLM_SERVER_URL=https://openrouter.ai/api/v1 # or https://api.deepinfra.com/v1/openai or https://api.openai.com/v1 or https://api.novita.ai/openai
3009+
LLM_SERVER_URL=https://openrouter.ai/api/v1 # or https://api.orcarouter.ai/v1 or https://api.deepinfra.com/v1/openai or https://api.openai.com/v1 or https://api.novita.ai/openai
30073010
LLM_SERVER_KEY=your_api_key
30083011
LLM_SERVER_MODEL= # Leave empty, as models are specified in the config
3009-
LLM_SERVER_CONFIG_PATH=/opt/pentagi/conf/openrouter.provider.yml # or deepinfra.provider.ymll or custom-openai.provider.yml or novita.provider.yml
3010-
LLM_SERVER_PROVIDER= # Provider name for LiteLLM proxy (e.g., openrouter, deepseek, moonshot, novita)
3012+
LLM_SERVER_CONFIG_PATH=/opt/pentagi/conf/openrouter.provider.yml # or orcarouter.provider.yml or deepinfra.provider.ymll or custom-openai.provider.yml or novita.provider.yml
3013+
LLM_SERVER_PROVIDER= # Provider name for LiteLLM proxy (e.g., openrouter, orcarouter, deepseek, moonshot, novita)
30113014
LLM_SERVER_LEGACY_REASONING=false # Controls reasoning format, for OpenAI must be true (default: false)
30123015
LLM_SERVER_PRESERVE_REASONING=false # Preserve reasoning content in multi-turn conversations (required by Moonshot, default: false)
30133016
@@ -3127,6 +3130,7 @@ When using LiteLLM proxy, set the corresponding `*_PROVIDER` variable to enable
31273130
- `dashscope` - for Qwen models (`QWEN_PROVIDER=dashscope``dashscope/qwen-plus`)
31283131
- `openai`, `anthropic`, `gemini` - for major cloud providers
31293132
- `openrouter` - for OpenRouter aggregator
3133+
- `orcarouter` - for OrcaRouter aggregator
31303134
- `deepinfra` - for DeepInfra hosting
31313135
- `novita` - for Novita AI
31323136
- Any other provider name configured in your LiteLLM instance
Lines changed: 134 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,134 @@
1+
# OrcaRouter provider configuration (OpenAI-compatible meta-router).
2+
# Use via the custom LLM endpoint:
3+
# LLM_SERVER_URL=https://api.orcarouter.ai/v1
4+
# LLM_SERVER_KEY=sk-orca-...
5+
# LLM_SERVER_CONFIG_PATH=/opt/pentagi/conf/orcarouter.provider.yml
6+
# Model IDs are namespaced (e.g. openai/gpt-5.5); "orcarouter/auto" is a virtual
7+
# adaptive router. Prices are indicative - regenerate from https://www.orcarouter.ai/api/pricing.
8+
9+
simple:
10+
model: "google/gemini-3.5-flash"
11+
temperature: 0.3
12+
top_p: 0.9
13+
n: 1
14+
max_tokens: 4000
15+
price:
16+
input: 0.3
17+
output: 2.5
18+
19+
simple_json:
20+
model: "google/gemini-3.5-flash"
21+
temperature: 0.3
22+
top_p: 1.0
23+
n: 1
24+
max_tokens: 4000
25+
json: true
26+
price:
27+
input: 0.3
28+
output: 2.5
29+
30+
primary_agent:
31+
model: "openai/gpt-5.5"
32+
n: 1
33+
max_tokens: 6000
34+
reasoning:
35+
effort: high
36+
price:
37+
input: 1.25
38+
output: 10.0
39+
40+
assistant:
41+
model: "openai/gpt-5.5"
42+
n: 1
43+
max_tokens: 6000
44+
reasoning:
45+
effort: high
46+
price:
47+
input: 1.25
48+
output: 10.0
49+
50+
generator:
51+
model: "anthropic/claude-sonnet-4.6"
52+
n: 1
53+
max_tokens: 12000
54+
reasoning:
55+
max_tokens: 4000
56+
price:
57+
input: 3.0
58+
output: 15.0
59+
60+
refiner:
61+
model: "openai/gpt-5.5"
62+
n: 1
63+
max_tokens: 10000
64+
reasoning:
65+
effort: medium
66+
price:
67+
input: 1.25
68+
output: 10.0
69+
70+
adviser:
71+
model: "openai/gpt-5.5"
72+
n: 1
73+
max_tokens: 6000
74+
reasoning:
75+
effort: high
76+
price:
77+
input: 1.25
78+
output: 10.0
79+
80+
reflector:
81+
model: "google/gemini-3.5-flash"
82+
temperature: 0.5
83+
top_p: 1.0
84+
n: 1
85+
max_tokens: 4000
86+
price:
87+
input: 0.3
88+
output: 2.5
89+
90+
searcher:
91+
model: "google/gemini-3.5-flash"
92+
n: 1
93+
max_tokens: 4000
94+
price:
95+
input: 0.3
96+
output: 2.5
97+
98+
enricher:
99+
model: "google/gemini-3.5-flash"
100+
temperature: 0.5
101+
top_p: 1.0
102+
n: 1
103+
max_tokens: 6000
104+
price:
105+
input: 0.3
106+
output: 2.5
107+
108+
coder:
109+
model: "anthropic/claude-sonnet-4.6"
110+
n: 1
111+
max_tokens: 8000
112+
reasoning:
113+
max_tokens: 2000
114+
price:
115+
input: 3.0
116+
output: 15.0
117+
118+
installer:
119+
model: "google/gemini-3.5-flash"
120+
n: 1
121+
max_tokens: 4000
122+
price:
123+
input: 0.3
124+
output: 2.5
125+
126+
pentester:
127+
model: "openai/gpt-5.5"
128+
n: 1
129+
max_tokens: 6000
130+
reasoning:
131+
effort: high
132+
price:
133+
input: 1.25
134+
output: 10.0

0 commit comments

Comments
 (0)