You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/get-started/pages/cloud-overview.adoc
+5-11Lines changed: 5 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,15 +6,15 @@ Redpanda Cloud is a complete data streaming and agentic data plane platform deli
6
6
7
7
== Redpanda Agentic Data Plane (ADP)
8
8
9
-
Redpanda ADP is an enterprise-grade infrastructure for building, deploying, and managing AI agents at scale. Redpanda ADP provides unified governance, observability, and security for agentic applications while leveraging Redpanda's streaming and analytical capabilities as the foundational data fabric.
9
+
Redpanda ADP is an enterprise-grade infrastructure for building, deploying, and managing AI agents at scale. Redpanda ADP provides unified governance, observability, and security for agentic applications while leveraging Redpanda's streaming and analytical foundation.
10
10
11
11
NOTE: The Agentic Data Plane is supported on BYOC clusters running with AWS and Redpanda version 25.3 and later.
12
12
13
13
Redpanda ADP is built on open standards and protocols, allowing you to pick and choose components that fit your needs. Integrate with existing agent frameworks, data processing systems, or custom code. It includes the following key components:
14
14
15
-
* **AI agents**: Deploy declarative agents or bring your own agent frameworks (LangChain, LlamaIndex, and others). Build multi-agent systems where specialized sub-agents handle specific responsibilities, following single-responsibility principles.
16
-
* **MCP servers**: Build lightweight data and action interfaces using a low-code framework based on xref:develop:connect/about.adoc[Redpanda Connect]. Connect to hundreds of data sources (databases, cloud storage, APIs) and enforce fine-grained policies that programmatically prevent prompt injection and SQL injection attacks. MCP servers are extremely lightweight—run dozens on minimal resources—with OIDC-based access control and real-time debugging capabilities.
17
-
* **AI Gateway**: Manage LLM provider access with cost controls, rate limiting, intelligent routing, and failover support across multiple providers.
15
+
* **glossterm:AI agent[,AI agents]**: Deploy declarative agents or bring your own agent frameworks (such as LangChain or LlamaIndex). Build multi-agent systems where specialized glossterm:subagent[,sub-agents] handle specific responsibilities, following single-responsibility principles.
16
+
* **glossterm:MCP server[,MCP servers]**: Build lightweight data and action interfaces using xref:develop:connect/about.adoc[Redpanda Connect] or your own hosted MCP servers. Connect to hundreds of data sources (databases, cloud storage, APIs) and enforce fine-grained policies that programmatically prevent prompt injection and SQL injection attacks. MCP servers are extremely lightweight, with OIDC-based access control and real-time debugging capabilities.
17
+
* **AI Gateway**: Manage large language model (LLM) provider access with cost controls, rate limiting, intelligent routing, and failover support across multiple providers.
18
18
//* **Catalog**: Maintain a centralized repository of agents, MCP servers, tools, and policies. Share components across teams and enforce organization-wide standards.
19
19
20
20
=== Enterprise capabilities for AI agents
@@ -25,13 +25,8 @@ Redpanda ADP addresses critical enterprise requirements for AI agent deployments
25
25
26
26
*Unified authorization*: All components use OIDC-based authentication with an "on-behalf-of" authorization model. When a user invokes an agent, the agent inherits the intersection of its own permissions and the user's permissions, ensuring proper data access scoping.
27
27
28
-
*Complete observability*: Redpanda ADP provides two levels of inspection: execution logs (transcripts) capture every agent action with 100% sampling using OpenTelemetry standards, while real-time debugging tools allow inspection of individual MCP server calls. Traces span across services and go as deep as needed, down to individual tool invocations with full timing data. View detailed agent actions in Redpanda Console and replay data for agent evaluations.
28
+
*Complete observability*: Redpanda ADP provides two levels of inspection: execution logs (glossterm:transcript[,transcripts]) capture every agent action with 100% sampling using OpenTelemetry standards, while real-time debugging tools allow inspection of individual MCP server calls. Traces span across services and go as deep as needed, down to individual tool invocations with full timing data. View detailed agent actions in Redpanda Console and replay data for agent evaluations.
29
29
30
-
*Compliance and audit*: For industries requiring multi-year audit trails, Redpanda ADP records every agent action and data source used in decision-making. Execution logs are stored in Redpanda topics and can be materialized to Iceberg tables for long-term retention and analysis.
31
-
32
-
=== Use cases
33
-
34
-
Organizations can use Redpanda ADP to:
35
30
36
31
* *Automate operational workflows*: Create specialized agents for building management, infrastructure monitoring, compliance reporting, and other domain-specific tasks
37
32
* *Monitor manufacturing and operations*: Deploy multi-agent systems that analyze factory machine telemetry in real-time, detect anomalies, search equipment manuals, and create maintenance tickets automatically. Use data aggregation patterns (like tumbling windows) to process high-volume sensor data before sending insights to agents.
@@ -156,7 +151,6 @@ Serverless is the fastest and easiest way to start data streaming. With Serverle
156
151
157
152
[NOTE]
158
153
====
159
-
* Serverless on AWS is currently in a glossterm:LA[,limited availability (LA)] release.
160
154
* Serverless on GCP is currently in a glossterm:beta[] release.
Copy file name to clipboardExpand all lines: modules/get-started/pages/cluster-types/byoc/aws/create-byoc-cluster-aws.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,7 +25,7 @@ To verify access, you should be able to successfully run `aws sts get-caller-ide
25
25
== Create a BYOC cluster
26
26
27
27
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
28
-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
28
+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
29
29
. Enter a cluster name, then select the resource group, provider (AWS), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
Copy file name to clipboardExpand all lines: modules/get-started/pages/cluster-types/byoc/azure/create-byoc-cluster-azure.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -149,7 +149,7 @@ If you see restrictions, https://learn.microsoft.com/en-us/troubleshoot/azure/ge
149
149
To create a Redpanda cluster in your Azure VNet, follow the <<prerequisites,prerequisites>> then follow the instructions in the Redpanda Cloud UI. The UI contains the parameters necessary to successfully run `rpk cloud byoc apply`.
150
150
151
151
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
152
-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
152
+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
153
153
. Enter a cluster name, then select the resource group, provider (Azure), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
18
-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
18
+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
19
19
+
20
20
Enter a cluster name, then select the resource group, provider (GCP), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
Copy file name to clipboardExpand all lines: modules/get-started/pages/cluster-types/create-dedicated-cloud-cluster.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ After you log in to https://cloud.redpanda.com[Redpanda Cloud^], you land on the
6
6
7
7
== Create a Dedicated cluster
8
8
9
-
. On the Clusters page, click *Create cluster*, then click *Create Dedicated cluster*.
9
+
. On the Clusters page, click *Create cluster*, then click *Create* for Dedicated.
10
10
+
11
11
Enter a cluster name, then select the resource group, cloud provider (AWS, GCP, or Azure), xref:reference:tiers/dedicated-tiers.adoc[region, tier], availability, and Redpanda version.
. In the https://cloud.redpanda.com[Redpanda Cloud UI^], on the **Clusters** page, click **Create cluster**, then click **Create Serverless cluster**.
46
+
. In the https://cloud.redpanda.com[Redpanda Cloud Console^], on the **Clusters** page, click **Create cluster**, then click **Create** for Serverless.
48
47
49
-
. Enter a cluster name, then select the resource group. If you don't have an existing resource group, you can create one. Refresh the page to see newly-created resource groups.
48
+
. Enter a cluster name, then select the resource group.
49
+
+
50
+
If you don't have an existing resource group, you can create one. Refresh the page to see newly-created resource groups.
50
51
51
52
. Select a cloud provider and xref:reference:tiers/serverless-regions.adoc[region]. For best performance, select the region closest to your applications. Redpanda expects your applications to be deployed in the same cloud provider and region as your Serverless cluster.
52
53
+
53
-
Serverless clusters are not guaranteed to be pinned to a particular availability zone within the selected region.
54
+
Clusters on AWS can enable private access between their VPC and Redpanda, so data does not traverse the public internet. Private connectivity is implemented using AWS PrivateLink for secure traffic.
55
+
+
56
+
** When you enable both public access and private access on the cluster, you can choose between the public address or the private address. When the public address is used the data flows over the public internet.
57
+
** You can either create a new PrivateLink or use an existing one from the same resource group.
58
+
** You can enable or disable private access at any time on the cluster's *Settings* page.
NOTE: After private access is disabled, attempts to reach the private endpoints will fail. However, the PrivateLink endpoint in your AWS account and the PrivateLink resource in Redpanda Cloud both remain provisioned and continue to incur charges until you explicitly delete them.
62
+
63
+
. Click **Create cluster**.
54
64
55
-
. Add team members and grant them access with glossterm:ACL[,access control lists (ACLs)] on the *Security* page.
65
+
. To start working with your cluster, go to the *Topics* page to create a topic and produce messages to it. Add team members and grant them access with ACLs on the *Security* page.
56
66
57
67
== Interact with your cluster
58
68
@@ -62,7 +72,7 @@ The *Overview* page lists your bootstrap server URL and security settings in the
62
72
63
73
Or, Redpanda can generate a sample application to interact with your cluster. Run xref:reference:rpk/rpk-generate/rpk-generate-app.adoc[`rpk generate app`], and select Go as the language. Follow the commands in the terminal to run the application, create a demo topic, produce to the topic, and consume the data back.
64
74
65
-
Follow the steps in the UI to use `rpk` to interact with your cluster from the command line. Here are some helpful commands:
75
+
Follow the steps in the Console to use `rpk` to interact with your cluster from the command line. Here are some helpful commands:
66
76
67
77
* xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[`rpk cloud login`]: Use this to log in to Redpanda Cloud or to refresh the session.
68
78
* xref:reference:rpk/rpk-topic.adoc[`rpk topic`]: Use this to manage topics, produce data, and consume data.
@@ -71,31 +81,24 @@ Follow the steps in the UI to use `rpk` to interact with your cluster from the c
71
81
72
82
NOTE: Redpanda Serverless is opinionated about Kafka configurations. For example, automatic topic creation is disabled. Some systems expect the Kafka service to automatically create topics when a message is produced to a topic that doesn't exist. Create topics on the *Topics* page or with `rpk topic create`.
73
83
74
-
The *How to connect - Kafka API* tab lists your bootstrap server URL and security settings. This area includes code examples for creating a Kafka client to interact with your cluster. Or, Redpanda can generate a sample application to interact with your cluster. Run xref:reference:rpk/rpk-generate/rpk-generate-app.adoc[`rpk generate app`], and select your preferred programming language. Follow the commands in the terminal to run the application, create a demo topic, produce to the topic, and consume the data back.
75
-
76
-
Explore the rest of the UI:
77
-
78
-
* Go to the *Topics* page to create new topics for data streams.
79
-
* Under the *Actions* dropdown, produce messages to topics.
80
-
* Add team members with permissions on the *Security* page.
81
-
82
84
== Supported features
83
85
84
86
* Redpanda Serverless supports the Kafka API. Serverless clusters work with all Kafka clients. See xref:develop:kafka-clients.adoc[].
85
-
* Serverless clusters support all major Apache Kafka messages for managing topics, producing/consuming data (including transactions), managing groups, managing offsets, and managing ACLs. (User management is available in the Redpanda Cloud UI or with `rpk security acl`.)
87
+
* Serverless clusters support all major Apache Kafka messages for managing topics, producing/consuming data (including transactions), managing groups, managing offsets, and managing ACLs. (User management is available in the https://cloud.redpanda.com[Redpanda Cloud Console^] or with `rpk security acl`.)
86
88
87
89
=== Unsupported features
88
90
89
91
Not all features included in BYOC clusters are available in Serverless. For example, the following features are not supported:
90
92
91
93
* HTTP Proxy API
92
-
* Private networking (VPC peering or AWS PrivateLink)
93
94
* Multiple availability zones (AZs)
94
95
* RBAC in the data plane and mTLS authentication for Kafka API clients
95
96
* Kafka Connect
96
97
97
98
== Next steps
98
99
100
+
* xref:networking:serverless/aws/index.adoc[Set up private access for Serverless clusters]
101
+
* xref:manage:terraform-provider.adoc[Manage Redpanda Cloud with Terraform]
99
102
* xref:get-started:cloud-overview.adoc[Learn more about Redpanda Cloud]
0 commit comments