Skip to content

Commit 89b2491

Browse files
committed
Merge branch 'update-cloud-overview-adp-focus' into adp-pkg1
# Conflicts: # local-antora-playbook.yml # modules/get-started/pages/cloud-overview.adoc # modules/get-started/pages/whats-new-cloud.adoc
2 parents 2261b3e + 7a08929 commit 89b2491

26 files changed

Lines changed: 728 additions & 68 deletions

modules/ROOT/nav.adoc

Lines changed: 10 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -382,7 +382,6 @@
382382
*** xref:develop:connect/guides/sync_responses.adoc[]
383383
*** xref:develop:connect/guides/migrate-unified-redpanda-migrator.adoc[]
384384
385-
386385
** xref:develop:connect/cookbooks/index.adoc[]
387386
*** xref:develop:connect/cookbooks/enrichments.adoc[]
388387
*** xref:develop:connect/cookbooks/filtering.adoc[]
@@ -464,6 +463,7 @@
464463
*** xref:manage:schema-reg/schema-reg-ui.adoc[]
465464
*** xref:manage:schema-reg/schema-reg-api.adoc[]
466465
*** xref:manage:schema-reg/schema-reg-authorization.adoc[Schema Registry Authorization]
466+
*** xref:manage:schema-reg/schema-id-validation.adoc[]
467467
*** xref:manage:schema-reg/record-deserialization.adoc[Deserialization]
468468
*** xref:manage:schema-reg/programmable-push-filters.adoc[Programmable Push Filters]
469469
*** xref:manage:schema-reg/edit-topic-configuration.adoc[Edit Topic Configuration]
@@ -491,31 +491,35 @@
491491
* xref:networking:index.adoc[Networking]
492492
** xref:networking:cloud-security-network.adoc[]
493493
** xref:networking:cidr-ranges.adoc[]
494+
** xref:networking:serverless/index.adoc[Serverless]
495+
*** xref:networking:serverless/aws/index.adoc[AWS]
496+
**** xref:networking:serverless/aws/privatelink-ui.adoc[Configure PrivateLink in the Cloud Console]
497+
**** xref:networking:serverless/aws/privatelink-api.adoc[Configure PrivateLink with the Cloud API]
494498
** xref:networking:byoc/index.adoc[BYOC]
495499
*** xref:networking:byoc/aws/index.adoc[AWS]
496500
**** xref:networking:byoc/aws/vpc-peering-aws.adoc[Add a Peering Connection]
497-
**** xref:networking:configure-privatelink-in-cloud-ui.adoc[Configure PrivateLink in the Cloud UI]
501+
**** xref:networking:configure-privatelink-in-cloud-ui.adoc[Configure PrivateLink in the Cloud Console]
498502
**** xref:networking:aws-privatelink.adoc[Configure PrivateLink with the Cloud API]
499503
**** xref:networking:byoc/aws/transit-gateway.adoc[Add a Transit Gateway]
500504
*** xref:networking:byoc/azure/index.adoc[Azure]
501505
**** xref:networking:azure-private-link-in-ui.adoc[]
502506
**** xref:networking:azure-private-link.adoc[]
503507
*** xref:networking:byoc/gcp/index.adoc[GCP]
504508
**** xref:networking:byoc/gcp/vpc-peering-gcp.adoc[Add a Peering Connection]
505-
**** xref:networking:configure-private-service-connect-in-cloud-ui.adoc[Configure Private Service Connect in the Cloud UI]
509+
**** xref:networking:configure-private-service-connect-in-cloud-ui.adoc[Configure Private Service Connect in the Cloud Console]
506510
**** xref:networking:gcp-private-service-connect.adoc[Configure Private Service Connect with the Cloud API]
507511
**** xref:networking:byoc/gcp/enable-global-access.adoc[Enable Global Access]
508512
** xref:networking:dedicated/index.adoc[Dedicated]
509513
*** xref:networking:dedicated/aws/index.adoc[AWS]
510514
**** xref:networking:dedicated/aws/vpc-peering.adoc[Add a Peering Connection]
511-
**** xref:networking:configure-privatelink-in-cloud-ui.adoc[Configure PrivateLink in the Cloud UI]
515+
**** xref:networking:configure-privatelink-in-cloud-ui.adoc[Configure PrivateLink in the Cloud Console]
512516
**** xref:networking:aws-privatelink.adoc[]
513517
*** xref:networking:dedicated/azure/index.adoc[Azure]
514-
**** xref:networking:azure-private-link-in-ui.adoc[]
518+
**** xref:networking:azure-private-link-in-ui.adoc[Configure Private Link in the Cloud Console]
515519
**** xref:networking:azure-private-link.adoc[]
516520
*** xref:networking:dedicated/gcp/index.adoc[GCP]
517521
**** xref:networking:dedicated/gcp/vpc-peering-gcp.adoc[Add a Peering Connection]
518-
**** xref:networking:dedicated/gcp/configure-psc-in-ui.adoc[Configure Private Service Connect in the Cloud UI]
522+
**** xref:networking:dedicated/gcp/configure-psc-in-ui.adoc[Configure Private Service Connect in the Cloud Console]
519523
**** xref:networking:dedicated/gcp/configure-psc-in-api.adoc[Configure Private Service Connect with the Cloud API]
520524
521525
* xref:security:index.adoc[Security]

modules/get-started/pages/cloud-overview.adoc

Lines changed: 5 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -6,15 +6,15 @@ Redpanda Cloud is a complete data streaming and agentic data plane platform deli
66

77
== Redpanda Agentic Data Plane (ADP)
88

9-
Redpanda ADP is an enterprise-grade infrastructure for building, deploying, and managing AI agents at scale. Redpanda ADP provides unified governance, observability, and security for agentic applications while leveraging Redpanda's streaming and analytical capabilities as the foundational data fabric.
9+
Redpanda ADP is an enterprise-grade infrastructure for building, deploying, and managing AI agents at scale. Redpanda ADP provides unified governance, observability, and security for agentic applications while leveraging Redpanda's streaming and analytical foundation.
1010

1111
NOTE: The Agentic Data Plane is supported on BYOC clusters running with AWS and Redpanda version 25.3 and later.
1212

1313
Redpanda ADP is built on open standards and protocols, allowing you to pick and choose components that fit your needs. Integrate with existing agent frameworks, data processing systems, or custom code. It includes the following key components:
1414

15-
* **AI agents**: Deploy declarative agents or bring your own agent frameworks (LangChain, LlamaIndex, and others). Build multi-agent systems where specialized sub-agents handle specific responsibilities, following single-responsibility principles.
16-
* **MCP servers**: Build lightweight data and action interfaces using a low-code framework based on xref:develop:connect/about.adoc[Redpanda Connect]. Connect to hundreds of data sources (databases, cloud storage, APIs) and enforce fine-grained policies that programmatically prevent prompt injection and SQL injection attacks. MCP servers are extremely lightweight—run dozens on minimal resources—with OIDC-based access control and real-time debugging capabilities.
17-
* **AI Gateway**: Manage LLM provider access with cost controls, rate limiting, intelligent routing, and failover support across multiple providers.
15+
* **glossterm:AI agent[,AI agents]**: Deploy declarative agents or bring your own agent frameworks (such as LangChain or LlamaIndex). Build multi-agent systems where specialized glossterm:subagent[,sub-agents] handle specific responsibilities, following single-responsibility principles.
16+
* **glossterm:MCP server[,MCP servers]**: Build lightweight data and action interfaces using xref:develop:connect/about.adoc[Redpanda Connect] or your own hosted MCP servers. Connect to hundreds of data sources (databases, cloud storage, APIs) and enforce fine-grained policies that programmatically prevent prompt injection and SQL injection attacks. MCP servers are extremely lightweight, with OIDC-based access control and real-time debugging capabilities.
17+
* **AI Gateway**: Manage large language model (LLM) provider access with cost controls, rate limiting, intelligent routing, and failover support across multiple providers.
1818
//* **Catalog**: Maintain a centralized repository of agents, MCP servers, tools, and policies. Share components across teams and enforce organization-wide standards.
1919

2020
=== Enterprise capabilities for AI agents
@@ -25,13 +25,8 @@ Redpanda ADP addresses critical enterprise requirements for AI agent deployments
2525

2626
*Unified authorization*: All components use OIDC-based authentication with an "on-behalf-of" authorization model. When a user invokes an agent, the agent inherits the intersection of its own permissions and the user's permissions, ensuring proper data access scoping.
2727

28-
*Complete observability*: Redpanda ADP provides two levels of inspection: execution logs (transcripts) capture every agent action with 100% sampling using OpenTelemetry standards, while real-time debugging tools allow inspection of individual MCP server calls. Traces span across services and go as deep as needed, down to individual tool invocations with full timing data. View detailed agent actions in Redpanda Console and replay data for agent evaluations.
28+
*Complete observability*: Redpanda ADP provides two levels of inspection: execution logs (glossterm:transcript[,transcripts]) capture every agent action with 100% sampling using OpenTelemetry standards, while real-time debugging tools allow inspection of individual MCP server calls. Traces span across services and go as deep as needed, down to individual tool invocations with full timing data. View detailed agent actions in Redpanda Console and replay data for agent evaluations.
2929

30-
*Compliance and audit*: For industries requiring multi-year audit trails, Redpanda ADP records every agent action and data source used in decision-making. Execution logs are stored in Redpanda topics and can be materialized to Iceberg tables for long-term retention and analysis.
31-
32-
=== Use cases
33-
34-
Organizations can use Redpanda ADP to:
3530

3631
* *Automate operational workflows*: Create specialized agents for building management, infrastructure monitoring, compliance reporting, and other domain-specific tasks
3732
* *Monitor manufacturing and operations*: Deploy multi-agent systems that analyze factory machine telemetry in real-time, detect anomalies, search equipment manuals, and create maintenance tickets automatically. Use data aggregation patterns (like tumbling windows) to process high-volume sensor data before sending insights to agents.
@@ -156,7 +151,6 @@ Serverless is the fastest and easiest way to start data streaming. With Serverle
156151

157152
[NOTE]
158153
====
159-
* Serverless on AWS is currently in a glossterm:LA[,limited availability (LA)] release.
160154
* Serverless on GCP is currently in a glossterm:beta[] release.
161155
====
162156

modules/get-started/pages/cluster-types/byoc/aws/create-byoc-cluster-aws.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ To verify access, you should be able to successfully run `aws sts get-caller-ide
2525
== Create a BYOC cluster
2626

2727
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
28-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
28+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
2929
. Enter a cluster name, then select the resource group, provider (AWS), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
3030
+
3131
[NOTE]

modules/get-started/pages/cluster-types/byoc/azure/create-byoc-cluster-azure.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -149,7 +149,7 @@ If you see restrictions, https://learn.microsoft.com/en-us/troubleshoot/azure/ge
149149
To create a Redpanda cluster in your Azure VNet, follow the <<prerequisites,prerequisites>> then follow the instructions in the Redpanda Cloud UI. The UI contains the parameters necessary to successfully run `rpk cloud byoc apply`.
150150

151151
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
152-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
152+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
153153
. Enter a cluster name, then select the resource group, provider (Azure), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
154154
+
155155
[NOTE]

modules/get-started/pages/cluster-types/byoc/gcp/create-byoc-cluster-gcp.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ include::partial$gpq-quotas.adoc[]
1515
== Create a BYOC cluster
1616

1717
. Log in to https://cloud.redpanda.com[Redpanda Cloud^].
18-
. On the Clusters page, click *Create cluster*, then click *Create BYOC cluster*.
18+
. On the Clusters page, click *Create cluster*, then click *Create* for BYOC.
1919
+
2020
Enter a cluster name, then select the resource group, provider (GCP), xref:reference:tiers/byoc-tiers.adoc[region, tier], availability, and Redpanda version.
2121
+

modules/get-started/pages/cluster-types/create-dedicated-cloud-cluster.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ After you log in to https://cloud.redpanda.com[Redpanda Cloud^], you land on the
66

77
== Create a Dedicated cluster
88

9-
. On the Clusters page, click *Create cluster*, then click *Create Dedicated cluster*.
9+
. On the Clusters page, click *Create cluster*, then click *Create* for Dedicated.
1010
+
1111
Enter a cluster name, then select the resource group, cloud provider (AWS, GCP, or Azure), xref:reference:tiers/dedicated-tiers.adoc[region, tier], availability, and Redpanda version.
1212
+

modules/get-started/pages/cluster-types/serverless.adoc

Lines changed: 20 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,7 @@ Serverless is the fastest and easiest way to start data streaming. With Serverle
77

88
[NOTE]
99
====
10-
* Serverless on AWS is currently in a glossterm:LA[,limited availability (LA)] release.
11-
* Serverless on GCP is currently in a glossterm:beta[] release.
10+
Serverless on GCP is currently in a glossterm:beta[] release.
1211
1312
====
1413

@@ -44,15 +43,26 @@ include::get-started:partial$get-started-serverless.adoc[]
4443

4544
To create a Serverless cluster:
4645

47-
. In the https://cloud.redpanda.com[Redpanda Cloud UI^], on the **Clusters** page, click **Create cluster**, then click **Create Serverless cluster**.
46+
. In the https://cloud.redpanda.com[Redpanda Cloud Console^], on the **Clusters** page, click **Create cluster**, then click **Create** for Serverless.
4847

49-
. Enter a cluster name, then select the resource group. If you don't have an existing resource group, you can create one. Refresh the page to see newly-created resource groups.
48+
. Enter a cluster name, then select the resource group.
49+
+
50+
If you don't have an existing resource group, you can create one. Refresh the page to see newly-created resource groups.
5051

5152
. Select a cloud provider and xref:reference:tiers/serverless-regions.adoc[region]. For best performance, select the region closest to your applications. Redpanda expects your applications to be deployed in the same cloud provider and region as your Serverless cluster.
5253
+
53-
Serverless clusters are not guaranteed to be pinned to a particular availability zone within the selected region.
54+
Clusters on AWS can enable private access between their VPC and Redpanda, so data does not traverse the public internet. Private connectivity is implemented using AWS PrivateLink for secure traffic.
55+
+
56+
** When you enable both public access and private access on the cluster, you can choose between the public address or the private address. When the public address is used the data flows over the public internet.
57+
** You can either create a new PrivateLink or use an existing one from the same resource group.
58+
** You can enable or disable private access at any time on the cluster's *Settings* page.
59+
** Enabling private access incurs additional charges.
60+
+
61+
NOTE: After private access is disabled, attempts to reach the private endpoints will fail. However, the PrivateLink endpoint in your AWS account and the PrivateLink resource in Redpanda Cloud both remain provisioned and continue to incur charges until you explicitly delete them.
62+
63+
. Click **Create cluster**.
5464

55-
. Add team members and grant them access with glossterm:ACL[,access control lists (ACLs)] on the *Security* page.
65+
. To start working with your cluster, go to the *Topics* page to create a topic and produce messages to it. Add team members and grant them access with ACLs on the *Security* page.
5666

5767
== Interact with your cluster
5868

@@ -62,7 +72,7 @@ The *Overview* page lists your bootstrap server URL and security settings in the
6272

6373
Or, Redpanda can generate a sample application to interact with your cluster. Run xref:reference:rpk/rpk-generate/rpk-generate-app.adoc[`rpk generate app`], and select Go as the language. Follow the commands in the terminal to run the application, create a demo topic, produce to the topic, and consume the data back.
6474

65-
Follow the steps in the UI to use `rpk` to interact with your cluster from the command line. Here are some helpful commands:
75+
Follow the steps in the Console to use `rpk` to interact with your cluster from the command line. Here are some helpful commands:
6676

6777
* xref:reference:rpk/rpk-cloud/rpk-cloud-login.adoc[`rpk cloud login`]: Use this to log in to Redpanda Cloud or to refresh the session.
6878
* xref:reference:rpk/rpk-topic.adoc[`rpk topic`]: Use this to manage topics, produce data, and consume data.
@@ -71,31 +81,24 @@ Follow the steps in the UI to use `rpk` to interact with your cluster from the c
7181

7282
NOTE: Redpanda Serverless is opinionated about Kafka configurations. For example, automatic topic creation is disabled. Some systems expect the Kafka service to automatically create topics when a message is produced to a topic that doesn't exist. Create topics on the *Topics* page or with `rpk topic create`.
7383

74-
The *How to connect - Kafka API* tab lists your bootstrap server URL and security settings. This area includes code examples for creating a Kafka client to interact with your cluster. Or, Redpanda can generate a sample application to interact with your cluster. Run xref:reference:rpk/rpk-generate/rpk-generate-app.adoc[`rpk generate app`], and select your preferred programming language. Follow the commands in the terminal to run the application, create a demo topic, produce to the topic, and consume the data back.
75-
76-
Explore the rest of the UI:
77-
78-
* Go to the *Topics* page to create new topics for data streams.
79-
* Under the *Actions* dropdown, produce messages to topics.
80-
* Add team members with permissions on the *Security* page.
81-
8284
== Supported features
8385

8486
* Redpanda Serverless supports the Kafka API. Serverless clusters work with all Kafka clients. See xref:develop:kafka-clients.adoc[].
85-
* Serverless clusters support all major Apache Kafka messages for managing topics, producing/consuming data (including transactions), managing groups, managing offsets, and managing ACLs. (User management is available in the Redpanda Cloud UI or with `rpk security acl`.)
87+
* Serverless clusters support all major Apache Kafka messages for managing topics, producing/consuming data (including transactions), managing groups, managing offsets, and managing ACLs. (User management is available in the https://cloud.redpanda.com[Redpanda Cloud Console^] or with `rpk security acl`.)
8688

8789
=== Unsupported features
8890

8991
Not all features included in BYOC clusters are available in Serverless. For example, the following features are not supported:
9092

9193
* HTTP Proxy API
92-
* Private networking (VPC peering or AWS PrivateLink)
9394
* Multiple availability zones (AZs)
9495
* RBAC in the data plane and mTLS authentication for Kafka API clients
9596
* Kafka Connect
9697

9798
== Next steps
9899

100+
* xref:networking:serverless/aws/index.adoc[Set up private access for Serverless clusters]
101+
* xref:manage:terraform-provider.adoc[Manage Redpanda Cloud with Terraform]
99102
* xref:get-started:cloud-overview.adoc[Learn more about Redpanda Cloud]
100103
* xref:get-started:config-topics.adoc[Manage topics]
101104
* xref:billing:billing.adoc[Learn about billing]

0 commit comments

Comments
 (0)