@@ -76,220 +76,6 @@ All requests route through Portkey automatically.
7676** Want fallbacks, load balancing, or caching?** Create a [ Portkey Config] ( /product/ai-gateway/configs ) , attach it to your API key, and set Chat Model to ` dummy ` . See [ Enterprise Governance] ( #3-enterprise-governance ) for examples.
7777</Note >
7878
79- # 3. Enterprise Governance
79+ import AdvancedFeatures from ' /snippets/portkey-advanced-features.mdx ' ;
8080
81- For organizations deploying AnythingLLM across teams, Portkey provides:
82- - ** Cost Management** : Budget limits and spend tracking per team
83- - ** Access Control** : Team-specific API keys with role-based permissions
84- - ** Usage Analytics** : Track patterns across teams and projects
85- - ** Model Management** : Control which models teams can access
86-
87- <AccordionGroup >
88- <Accordion title = " Set Budget Limits Per Team" >
89-
90- Create team-specific providers with budget and rate limits:
91-
92- 1 . Go to [ Model Catalog] ( https://app.portkey.ai/model-catalog ) → ** Add Provider**
93- 2 . Create providers for each team (e.g., ` openai-frontend ` , ` anthropic-backend ` )
94- 3 . Set budget and rate limits per provider
95-
96- <Frame >
97- <img src = " /images/product/model-catalog/create-provider-page.png" width = " 500" />
98- </Frame >
99-
100- </Accordion >
101-
102- <Accordion title = " Control Model Access" >
103-
104- Provision only the models each team needs:
105-
106- <Frame >
107- <img src = " /images/product/model-catalog/model-provisioning-page.png" width = " 500" />
108- </Frame >
109-
110- Each team's provider slug gives access only to their approved models.
111- </Accordion >
112-
113- <Accordion title = " Add Reliability Features" >
114-
115- Use [ Portkey Configs] ( /product/ai-gateway/configs ) for fallbacks, load balancing, and caching.
116-
117- Example: Load-balance across providers
118-
119- ``` json
120- {
121- "strategy" : { "mode" : " load-balance" },
122- "targets" : [
123- { "override_params" : { "model" : " @openai-prod/gpt-4o" } },
124- { "override_params" : { "model" : " @anthropic-prod/claude-3-5-sonnet-20241022" } }
125- ]
126- }
127- ```
128-
129- Create configs at [ Configs] ( https://app.portkey.ai/configs ) .
130-
131- </Accordion >
132-
133- <Accordion title = " Create Team API Keys" >
134-
135- Generate API keys with metadata tracking:
136-
137- ``` python
138- from portkey_ai import Portkey
139-
140- portkey = Portkey(api_key = " YOUR_ADMIN_API_KEY" )
141-
142- api_key = portkey.api_keys.create(
143- name = " frontend-team" ,
144- type = " organisation" ,
145- workspace_id = " YOUR_WORKSPACE_ID" ,
146- defaults = {
147- " metadata" : {
148- " environment" : " production" ,
149- " team" : " frontend"
150- }
151- },
152- scopes = [" logs.view" , " configs.read" ]
153- )
154- ```
155-
156- See [ API Keys docs] ( /api-reference/admin-api/control-plane/api-keys/create-api-key ) .
157- </Accordion >
158-
159- <Accordion title = " Monitor Usage" >
160-
161- Track everything in the Portkey dashboard:
162- - Cost by team
163- - Model usage patterns
164- - Request volumes and errors
165- - Detailed logs for debugging
166-
167- <Frame >
168- <img src = " /images/integrations/observability.png" width = " 600" />
169- </Frame >
170- </Accordion >
171-
172- </AccordionGroup >
173-
174- # Portkey Features
175-
176- ### Observability
177- Track 40+ metrics including cost, tokens, and latency across all providers. Filter by team or project using metadata.
178-
179- <Frame >
180- <img src = " /images/integrations/observability.png" width = " 600" />
181- </Frame >
182-
183- ### Request Logs
184- Every request logged with complete details:
185- - Full request/response payloads
186- - Cost breakdown
187- - Performance metrics
188-
189- <Frame >
190- <img src = " /images/llms/openai/logs.png" ></img >
191- </Frame >
192-
193- ### 1600+ LLMs
194- Switch between any model through one interface:
195-
196- <Card title = " Supported Providers" icon = " layer-group" href = " /integrations/llms" >
197- View all 1600+ supported models
198- </Card >
199-
200- ### Metadata Tracking
201- Track custom metrics:
202- - Language and framework usage
203- - Task types (generation vs. completion)
204- - Project-specific patterns
205-
206- <Card title = " Custom Metadata" icon = " tag" href = " /product/observability/metadata" >
207- </Card >
208-
209- ### Enterprise Access
210-
211- <CardGroup cols = { 2 } >
212- <Card title = " Budget Controls" icon = " coins" href = " /product/model-catalog/integrations#3-budget-%26-rate-limits" >
213- Set spending limits with automatic cutoffs
214- </Card >
215-
216- <Card title = " SSO" icon = " key" href = " /product/enterprise-offering/org-management/sso" >
217- Enterprise SSO integration
218- </Card >
219-
220- <Card title = " Organization Management" icon = " building" href = " /product/enterprise-offering/org-management" >
221- Teams, projects, and role-based access
222- </Card >
223-
224- <Card title = " Audit Logs" icon = " shield-check" href = " /product/enterprise-offering/access-control-management#audit-logs" >
225- Compliance and audit logging
226- </Card >
227- </CardGroup >
228-
229- ### Reliability
230- <CardGroup cols = { 3 } >
231- <Card title = " Fallbacks" icon = " life-ring" href = " /product/ai-gateway/fallbacks" >
232- Auto-switch on provider failures
233- </Card >
234- <Card title = " Conditional Routing" icon = " route" href = " /product/ai-gateway/conditional-routing" >
235- Route based on complexity or language
236- </Card >
237- <Card title = " Load Balancing" icon = " balance-scale" href = " /product/ai-gateway/load-balancing" >
238- Distribute across providers
239- </Card >
240- <Card title = " Caching" icon = " database" href = " /product/ai-gateway/cache-simple-and-semantic" >
241- Cache common patterns
242- </Card >
243- <Card title = " Smart Retries" icon = " refresh" href = " /product/ai-gateway/automatic-retries" >
244- Automatic retry with backoff
245- </Card >
246- <Card title = " Budget Limits" icon = " shield-check" href = " /product/model-catalog/integrations#3-budget-%26-rate-limits" >
247- Enforce spending limits
248- </Card >
249- </CardGroup >
250-
251- ### Security Guardrails
252-
253- Protect your data:
254- - Prevent sensitive data leaks
255- - PII detection and masking
256- - Content filtering
257- - Custom security rules
258-
259- <Card title = " Guardrails" icon = " shield-check" href = " /product/guardrails" >
260- </Card >
261-
262- # FAQs
263- <AccordionGroup >
264-
265- <Accordion title = " How do I update budget limits?" >
266- Go to [ Model Catalog] ( https://app.portkey.ai/model-catalog ) → click your provider → update limits → save.
267- </Accordion >
268-
269- <Accordion title = " Can I use multiple providers with one API key?" >
270- Yes. Create a config with multiple providers and attach it to your API key.
271- </Accordion >
272-
273- <Accordion title = " How do I track costs per team?" >
274- Options:
275- - Create separate providers for each team
276- - Use metadata tags in requests
277- - Set up team-specific API keys
278- - Filter in the analytics dashboard
279- </Accordion >
280-
281- <Accordion title = " What happens when a team exceeds their budget?" >
282- Requests are blocked until limits are adjusted. Admins receive notifications.
283- </Accordion >
284-
285- </AccordionGroup >
286-
287- # Next Steps
288-
289- ** Join our Community**
290- - [ Discord Community] ( https://portkey.sh/discord-report )
291- - [ GitHub Repository] ( https://github.com/Portkey-AI )
292-
293- <Note >
294- For enterprise support and custom features, contact our [ enterprise team] ( https://calendly.com/portkey-ai ) .
295- </Note >
81+ <AdvancedFeatures />
0 commit comments