Skip to content

Commit 2c629fe

Browse files
committed
Updated enterprise governance features
1 parent fd1e360 commit 2c629fe

16 files changed

Lines changed: 315 additions & 2493 deletions

integrations/libraries/anythingllm.mdx

Lines changed: 2 additions & 216 deletions
Original file line numberDiff line numberDiff line change
@@ -76,220 +76,6 @@ All requests route through Portkey automatically.
7676
**Want fallbacks, load balancing, or caching?** Create a [Portkey Config](/product/ai-gateway/configs), attach it to your API key, and set Chat Model to `dummy`. See [Enterprise Governance](#3-enterprise-governance) for examples.
7777
</Note>
7878

79-
# 3. Enterprise Governance
79+
import AdvancedFeatures from '/snippets/portkey-advanced-features.mdx';
8080

81-
For organizations deploying AnythingLLM across teams, Portkey provides:
82-
- **Cost Management**: Budget limits and spend tracking per team
83-
- **Access Control**: Team-specific API keys with role-based permissions
84-
- **Usage Analytics**: Track patterns across teams and projects
85-
- **Model Management**: Control which models teams can access
86-
87-
<AccordionGroup>
88-
<Accordion title="Set Budget Limits Per Team">
89-
90-
Create team-specific providers with budget and rate limits:
91-
92-
1. Go to [Model Catalog](https://app.portkey.ai/model-catalog)**Add Provider**
93-
2. Create providers for each team (e.g., `openai-frontend`, `anthropic-backend`)
94-
3. Set budget and rate limits per provider
95-
96-
<Frame>
97-
<img src="/images/product/model-catalog/create-provider-page.png" width="500"/>
98-
</Frame>
99-
100-
</Accordion>
101-
102-
<Accordion title="Control Model Access">
103-
104-
Provision only the models each team needs:
105-
106-
<Frame>
107-
<img src="/images/product/model-catalog/model-provisioning-page.png" width="500"/>
108-
</Frame>
109-
110-
Each team's provider slug gives access only to their approved models.
111-
</Accordion>
112-
113-
<Accordion title="Add Reliability Features">
114-
115-
Use [Portkey Configs](/product/ai-gateway/configs) for fallbacks, load balancing, and caching.
116-
117-
Example: Load-balance across providers
118-
119-
```json
120-
{
121-
"strategy": { "mode": "load-balance" },
122-
"targets": [
123-
{ "override_params": { "model": "@openai-prod/gpt-4o" } },
124-
{ "override_params": { "model": "@anthropic-prod/claude-3-5-sonnet-20241022" } }
125-
]
126-
}
127-
```
128-
129-
Create configs at [Configs](https://app.portkey.ai/configs).
130-
131-
</Accordion>
132-
133-
<Accordion title="Create Team API Keys">
134-
135-
Generate API keys with metadata tracking:
136-
137-
```python
138-
from portkey_ai import Portkey
139-
140-
portkey = Portkey(api_key="YOUR_ADMIN_API_KEY")
141-
142-
api_key = portkey.api_keys.create(
143-
name="frontend-team",
144-
type="organisation",
145-
workspace_id="YOUR_WORKSPACE_ID",
146-
defaults={
147-
"metadata": {
148-
"environment": "production",
149-
"team": "frontend"
150-
}
151-
},
152-
scopes=["logs.view", "configs.read"]
153-
)
154-
```
155-
156-
See [API Keys docs](/api-reference/admin-api/control-plane/api-keys/create-api-key).
157-
</Accordion>
158-
159-
<Accordion title="Monitor Usage">
160-
161-
Track everything in the Portkey dashboard:
162-
- Cost by team
163-
- Model usage patterns
164-
- Request volumes and errors
165-
- Detailed logs for debugging
166-
167-
<Frame>
168-
<img src="/images/integrations/observability.png" width="600"/>
169-
</Frame>
170-
</Accordion>
171-
172-
</AccordionGroup>
173-
174-
# Portkey Features
175-
176-
### Observability
177-
Track 40+ metrics including cost, tokens, and latency across all providers. Filter by team or project using metadata.
178-
179-
<Frame>
180-
<img src="/images/integrations/observability.png" width="600"/>
181-
</Frame>
182-
183-
### Request Logs
184-
Every request logged with complete details:
185-
- Full request/response payloads
186-
- Cost breakdown
187-
- Performance metrics
188-
189-
<Frame>
190-
<img src="/images/llms/openai/logs.png"></img>
191-
</Frame>
192-
193-
### 1600+ LLMs
194-
Switch between any model through one interface:
195-
196-
<Card title="Supported Providers" icon="layer-group" href="/integrations/llms">
197-
View all 1600+ supported models
198-
</Card>
199-
200-
### Metadata Tracking
201-
Track custom metrics:
202-
- Language and framework usage
203-
- Task types (generation vs. completion)
204-
- Project-specific patterns
205-
206-
<Card title="Custom Metadata" icon="tag" href="/product/observability/metadata">
207-
</Card>
208-
209-
### Enterprise Access
210-
211-
<CardGroup cols={2}>
212-
<Card title="Budget Controls" icon="coins" href="/product/model-catalog/integrations#3-budget-%26-rate-limits">
213-
Set spending limits with automatic cutoffs
214-
</Card>
215-
216-
<Card title="SSO" icon="key" href="/product/enterprise-offering/org-management/sso">
217-
Enterprise SSO integration
218-
</Card>
219-
220-
<Card title="Organization Management" icon="building" href="/product/enterprise-offering/org-management">
221-
Teams, projects, and role-based access
222-
</Card>
223-
224-
<Card title="Audit Logs" icon="shield-check" href="/product/enterprise-offering/access-control-management#audit-logs">
225-
Compliance and audit logging
226-
</Card>
227-
</CardGroup>
228-
229-
### Reliability
230-
<CardGroup cols={3}>
231-
<Card title="Fallbacks" icon="life-ring" href="/product/ai-gateway/fallbacks">
232-
Auto-switch on provider failures
233-
</Card>
234-
<Card title="Conditional Routing" icon="route" href="/product/ai-gateway/conditional-routing">
235-
Route based on complexity or language
236-
</Card>
237-
<Card title="Load Balancing" icon="balance-scale" href="/product/ai-gateway/load-balancing">
238-
Distribute across providers
239-
</Card>
240-
<Card title="Caching" icon="database" href="/product/ai-gateway/cache-simple-and-semantic">
241-
Cache common patterns
242-
</Card>
243-
<Card title="Smart Retries" icon="refresh" href="/product/ai-gateway/automatic-retries">
244-
Automatic retry with backoff
245-
</Card>
246-
<Card title="Budget Limits" icon="shield-check" href="/product/model-catalog/integrations#3-budget-%26-rate-limits">
247-
Enforce spending limits
248-
</Card>
249-
</CardGroup>
250-
251-
### Security Guardrails
252-
253-
Protect your data:
254-
- Prevent sensitive data leaks
255-
- PII detection and masking
256-
- Content filtering
257-
- Custom security rules
258-
259-
<Card title="Guardrails" icon="shield-check" href="/product/guardrails">
260-
</Card>
261-
262-
# FAQs
263-
<AccordionGroup>
264-
265-
<Accordion title="How do I update budget limits?">
266-
Go to [Model Catalog](https://app.portkey.ai/model-catalog) → click your provider → update limits → save.
267-
</Accordion>
268-
269-
<Accordion title="Can I use multiple providers with one API key?">
270-
Yes. Create a config with multiple providers and attach it to your API key.
271-
</Accordion>
272-
273-
<Accordion title="How do I track costs per team?">
274-
Options:
275-
- Create separate providers for each team
276-
- Use metadata tags in requests
277-
- Set up team-specific API keys
278-
- Filter in the analytics dashboard
279-
</Accordion>
280-
281-
<Accordion title="What happens when a team exceeds their budget?">
282-
Requests are blocked until limits are adjusted. Admins receive notifications.
283-
</Accordion>
284-
285-
</AccordionGroup>
286-
287-
# Next Steps
288-
289-
**Join our Community**
290-
- [Discord Community](https://portkey.sh/discord-report)
291-
- [GitHub Repository](https://github.com/Portkey-AI)
292-
293-
<Note>
294-
For enterprise support and custom features, contact our [enterprise team](https://calendly.com/portkey-ai).
295-
</Note>
81+
<AdvancedFeatures />

0 commit comments

Comments
 (0)