You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/ai-agents/pages/ai-gateway/admin/setup-guide.adoc
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,16 +19,16 @@ After completing this guide, you will be able to:
19
19
== Prerequisites
20
20
21
21
* Access to the Redpanda Cloud Console with administrator privileges
22
-
* API keys for at least one LLM provider (OpenAI or Anthropic)
22
+
* API keys for at least one LLM provider (OpenAI, Anthropic, Google AI)
23
23
* (Optional) MCP server endpoints if you plan to use tool aggregation
24
24
25
25
== Enable a provider
26
26
27
-
Providers represent upstream services (Anthropic, OpenAI) and associated credentials. Providers are disabled by default and must be enabled explicitly by an administrator.
27
+
Providers represent upstream services (Anthropic, OpenAI, Google AI) and associated credentials. Providers are disabled by default and must be enabled explicitly by an administrator.
28
28
29
29
. In the Redpanda Cloud Console, navigate to *AI Gateway* → *Providers*.
30
-
. Select a provider (for example, Anthropic or OpenAI).
31
-
. On the *Configuration* tab for the provider, click *Add configuration*.
30
+
. Select a provider (for example, Anthropic).
31
+
. On the Configuration tab for the provider, click *Add configuration*.
32
32
. Enter your API Key for the provider.
33
33
+
34
34
TIP: Store provider API keys securely. Each provider configuration can have multiple API keys for rotation and redundancy.
This guide shows you how to connect your AI agent or application to a Redpanda AI Gateway. You'll configure your client SDK, make your first request, and validate the integration.
11
+
This guide shows you how to connect your AI agent or application to a Redpanda AI Gateway. This is also called "Bring Your Own Agent" (BYOA). You'll configure your client SDK, make your first request, and validate the integration.
Copy file name to clipboardExpand all lines: modules/ai-agents/pages/ai-gateway/gateway-quickstart.adoc
+15-20Lines changed: 15 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,23 +16,18 @@ Before starting, ensure you have:
16
16
17
17
* Access to the AI Gateway UI (provided by your administrator)
18
18
* Admin permissions to configure providers and gateways
19
-
* API key for at least one LLM provider (OpenAIor Anthropic)
19
+
* API key for at least one LLM provider (OpenAI, Anthropic, or Google AI)
20
20
* Python 3.8+, Node.js 18+, or cURL (for testing)
21
21
22
22
== Configure a provider
23
23
24
24
Providers represent upstream LLM services (OpenAI, Anthropic) and their associated credentials. Providers are disabled by default and must be enabled explicitly.
25
25
26
26
. In AI Gateways, navigate to *Providers*.
27
-
. Select a provider (for example, OpenAI or Anthropic).
28
-
. On the *Configuration* tab, click *Add configuration* and enter your API Key.
27
+
. Select a provider (for example, OpenAI, Anthropic, Google AI).
28
+
. On the Configuration tab, click *Add configuration* and enter your API Key.
29
29
. Verify the provider status shows "Active".
30
30
31
-
AI Gateway currently supports:
32
-
33
-
* OpenAI
34
-
* Anthropic
35
-
36
31
== Enable models
37
32
38
33
After enabling a provider, enable the specific models you want to make available through your gateways.
@@ -60,9 +55,9 @@ A gateway is a logical configuration boundary that defines routing policies, rat
60
55
. Click *Create Gateway*.
61
56
. Configure the gateway:
62
57
+
63
-
* *Name*: Choose a descriptive name (for example, `my-first-gateway`)
64
-
* *Workspace*: Select a workspace (conceptually similar to a resource group)
65
-
* *Description*: Optional metadata for documentation
58
+
* Name: Choose a descriptive name (for example, `my-first-gateway`)
59
+
* Workspace: Select a workspace (conceptually similar to a resource group)
60
+
* Description: Optional metadata for documentation
66
61
67
62
. After creation, copy the *Gateway Endpoint* and *Gateway ID* from the gateway detail page. You'll need these for sending requests.
* *Environment separation*: Create separate gateways for staging and production
78
-
* *Team isolation*: One gateway per team for budget tracking
79
-
* *Customer multi-tenancy*: One gateway per customer for isolated policies
72
+
* Environment separation: Create separate gateways for staging and production
73
+
* Team isolation: One gateway per team for budget tracking
74
+
* Customer multi-tenancy: One gateway per customer for isolated policies
80
75
81
76
== Send your first request
82
77
@@ -193,10 +188,10 @@ Expected response:
193
188
194
189
If your request fails, check these common issues:
195
190
196
-
* *401 Unauthorized*: Verify your API key is valid
197
-
* *404 Not Found*: Confirm the base URL matches your gateway endpoint
198
-
* *Model not found*: Ensure the model is enabled in Step 2
199
-
* *Missing rp-aigw-id*: Add the gateway ID header to your request
191
+
* 401 Unauthorized: Verify your API key is valid
192
+
* 404 Not Found: Confirm the base URL matches your gateway endpoint
193
+
* Model not found: Ensure the model is enabled in Step 2
194
+
* Missing rp-aigw-id: Add the gateway ID header to your request
200
195
201
196
== Verify in observability dashboard
202
197
@@ -290,7 +285,7 @@ To add external tools (for example, Slack, GitHub), add their MCP server endpoin
290
285
291
286
=== Deferred tool loading
292
287
293
-
When many tools are aggregated, listing all tools upfront can consume significant tokens. With *deferred tool loading*, the MCP gateway initially returns only:
288
+
When many tools are aggregated, listing all tools upfront can consume significant tokens. With deferred tool loading, the MCP gateway initially returns only:
:description: Unified access layer for LLM providers and AI tools with centralized routing, policy enforcement, cost management, and observability.
2
+
:description: Learn about the unified access layer for LLM providers and AI tools with centralized routing, policy enforcement, cost management, and observability.
Redpanda AI Gateway provides a unified access layer for LLM providers and AI tools that sits between your applications and the AI services they use. It delivers centralized routing, policy enforcement, cost management, and observability for all your AI traffic.
0 commit comments