Skip to content

Commit 826ce59

Browse files
JakeSCahillmicheleRPFeediver1claude
authored
Release 26.1 docs for Cloud (#540)
* DOC-1606 Document Cloud Feature Support ordered rack region preferenc… (#537) * DOC01606 Document Cloud Feature Support ordered rack region preference for leader pinning * style edit * Apply suggestion from @JakeSCahill --------- Co-authored-by: Joyce Fee <102751339+Feediver1@users.noreply.github.com> Co-authored-by: Jake Cahill <45230295+JakeSCahill@users.noreply.github.com> * DOC-1809 Document Cloud Feature Group-based Access Control via OIDC (#536) * DOC-1809 Document Cloud Feature Group-based Access Control via OIDC * note GBAC not supported in Serverless * trigger Netlify rebuild * Apply suggestion from @JakeSCahill --------- Co-authored-by: Jake Cahill <45230295+JakeSCahill@users.noreply.github.com> * DOC-1811 Document Cloud Feature User-based throughput quotas (#534) * DOC-1811 Document Cloud Feature User-based throughput quotas * fix: restore docs repo branch to main in local playbook Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: Jake Cahill <45230295+JakeSCahill@users.noreply.github.com> * DOC-1825 Document Cloud Feature Cloud Topics (#526) * DOC-1825 Document Cloud Feature Cloud Topics * move files & add aliases, consistent with docs repo * Add Next steps section to create-topic.adoc and rename nav entry to Overview Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Update modules/develop/pages/topics/index.adoc Co-authored-by: Joyce Fee <102751339+Feediver1@users.noreply.github.com> * incorporate doc review feedback * chore: trigger Netlify rebuild for PR 526 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: restore docs repo branch to main in local playbook Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: Joyce Fee <102751339+Feediver1@users.noreply.github.com> Co-authored-by: Joyce Fee <joyce@redpanda.com> * DOC-1599 Document Cloud feature cross-region RRR on AWS (#524) * DOC-1599 Document feature cross-region RRR on AWS * coderabbit feedback * update What's New * Revert "DOC-1809 Document Cloud Feature Group-based Access Control via OIDC (#536)" This reverts commit e6c4671. --------- Co-authored-by: Michele Cyran <michele@redpanda.com> Co-authored-by: Joyce Fee <102751339+Feediver1@users.noreply.github.com> Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: Joyce Fee <joyce@redpanda.com>
1 parent 2d6250b commit 826ce59

12 files changed

Lines changed: 109 additions & 22 deletions

File tree

modules/ROOT/nav.adoc

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -398,8 +398,10 @@
398398
399399
* xref:develop:index.adoc[Develop]
400400
** xref:develop:kafka-clients.adoc[]
401-
** xref:get-started:create-topic.adoc[Create a Topic]
402-
** xref:get-started:config-topics.adoc[Manage Topics]
401+
** xref:develop:topics/index.adoc[Topics]
402+
*** xref:develop:topics/create-topic.adoc[Overview]
403+
*** xref:develop:topics/config-topics.adoc[Manage Topics]
404+
*** xref:develop:topics/cloud-topics.adoc[Manage Cloud Topics]
403405
** xref:develop:produce-data/index.adoc[Produce Data]
404406
*** xref:develop:produce-data/configure-producers.adoc[]
405407
*** xref:develop:produce-data/idempotent-producers.adoc[Idempotent Producers]
@@ -451,6 +453,7 @@
451453
*** xref:manage:cluster-maintenance/config-cluster.adoc[]
452454
*** xref:manage:audit-logging.adoc[]
453455
**** xref:manage:audit-logging/audit-log-samples.adoc[]
456+
*** xref:manage:cluster-maintenance/about-throughput-quotas.adoc[]
454457
*** xref:manage:cluster-maintenance/manage-throughput.adoc[]
455458
*** xref:manage:cluster-maintenance/configure-availability.adoc[]
456459
** xref:manage:mountable-topics.adoc[]

modules/develop/pages/managed-connectors/create-iceberg-sink-connector.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ Before you can create an Iceberg Sink connector in Redpanda Cloud, you
2222
must:
2323

2424
. https://iceberg.apache.org/concepts/catalog/[Set up an Iceberg catalog^].
25-
. Create the Iceberg connector control topic, which cannot be used by other connectors. For details, see xref:get-started:create-topic.adoc[Create a Topic].
25+
. Create the Iceberg connector control topic, which cannot be used by other connectors. For details, see xref:develop:topics/create-topic.adoc[Create a Topic].
2626

2727
== Limitations
2828

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,7 @@
1-
= Leader Pinning
2-
:description: Learn about leader pinning and how to configure a preferred partition leader location based on cloud availability zones or regions.
1+
= Configure Leader Pinning
2+
:description: Learn about Leader Pinning and how to configure a preferred partition leader location based on cloud availability zones or regions.
3+
:learning-objective-1: Configure preferred partition leader placement using rack labels
4+
:learning-objective-2: Configure ordered rack preference for priority-based leader failover
5+
:learning-objective-3: Identify conditions where Leader Pinning cannot place leaders in preferred racks
36

47
include::ROOT:develop:produce-data/leader-pinning.adoc[tag=single-source]
Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
= Manage Cloud Topics
2+
:description: Cloud Topics are Redpanda topics that enable users to trade off latency for lower costs.
3+
4+
include::ROOT:develop:manage-topics/cloud-topics.adoc[tag=single-source]
Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
= Manage Topics
22
:description: Learn how to create topics, update topic configurations, and delete topics or records.
3+
:page-aliases: get-started:config-topics.adoc
34

4-
include::ROOT:develop:config-topics.adoc[tag=single-source]
5+
include::ROOT:develop:config-topics.adoc[tag=single-source]

modules/get-started/pages/create-topic.adoc renamed to modules/develop/pages/topics/create-topic.adoc

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
= Create a Topic
1+
= Topics Overview
22
:description: Learn how to create a topic for a Redpanda Cloud cluster.
3-
:page-aliases: cloud:create-topic.adoc
3+
:page-aliases: cloud:create-topic.adoc, get-started:create-topic.adoc
44

55

66

@@ -22,29 +22,32 @@ include::develop:partial$topic-properties-warning.adoc[]
2222
| The number of partitions for the topic.
2323

2424
| *Replication factor*
25-
| The number of partition replicas for the topic.
25+
| The number of partition replicas for the topic.
2626

27-
Redpanda Cloud requires a minimum of 3 topic replicas. If a topic is created with a replication factor of 1, Redpanda resets the replication factor to 3.
27+
Redpanda Cloud requires a minimum of 3 topic replicas. If a topic is created with a replication factor of 1, Redpanda resets the replication factor to 3.
2828

2929
| *Cleanup policy*
30-
| The policy that determines how to clean up old log segments.
30+
| The policy that determines how to clean up old log segments.
3131

3232
The default is *delete*.
3333

3434
| *Retention time*
35-
| The maximum length of time to keep messages in a topic.
35+
| The maximum length of time to keep messages in a topic.
3636

3737
The default is *7 days*.
3838

3939
| *Retention size*
40-
| The maximum size of each partition. If a partition reaches this size and more messages are added, the oldest messages are deleted.
40+
| The maximum size of each partition. If a partition reaches this size and more messages are added, the oldest messages are deleted.
4141

4242
The default is *infinite*.
4343

4444
| *Message size*
45-
| The maximum size of a message or batch for a newly-created topic.
45+
| The maximum size of a message or batch for a newly-created topic.
4646

4747
The default is *20 MiB* for BYOC and Dedicated clusters, and *8 MiB* for Serverless clusters. You can increase this value up to *32 MiB* for BYOC and Dedicated clusters, and *20 MiB* for Serverless clusters, with the `message.max.bytes` topic property.
4848
|===
4949

50+
== Next steps
5051

52+
* xref:develop:topics/config-topics.adoc[]
53+
* xref:develop:topics/cloud-topics.adoc[]
Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
= Topics
2+
:description: Overview of standard topics in Redpanda Cloud.
3+
:page-layout: index

modules/get-started/pages/cluster-types/byoc/remote-read-replicas.adoc

Lines changed: 51 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,10 @@ Redpanda Cloud supports remote read replica topics in BYOC clusters on AWS or GC
88

99
== Prerequisites
1010

11-
* A BYOC source cluster in Ready state.
11+
To use remote read replicas, you need:
12+
1213
* A BYOC reader cluster in Ready state. This separate reader cluster must exist in the same Redpanda organization as the source cluster.
13-
** AWS: The reader cluster must be in the same region as the source cluster. The reader cluster must be in the same account as the source cluster.
14+
** AWS: The reader cluster can be in the same or a different region as the origin cluster's S3 bucket. For cross-region remote read replica topics, see <<create-cross-region-rrr-topic>>.
1415
** GCP: The reader cluster can be in the same or a different region as the source cluster. The reader cluster must be in the same project as the source cluster.
1516
** Azure: Remote read replicas are not supported.
1617

@@ -84,15 +85,60 @@ A source cluster cannot be deleted if it has remote read replica topics. When yo
8485
8586
====
8687

87-
== Create remote read replica
88+
== Create remote read replica topic
8889

8990
To create a remote read replica topic, run:
9091

9192
```bash
92-
rpk topic create my-topic -c redpanda.remote.readreplica=<source-cluster-tiered-storage-bucket-name> --tls-enabled
93+
rpk topic create <topic_name> -c redpanda.remote.readreplica=<source-cluster-bucket-name> --tls-enabled
9394
```
9495

95-
For standard BYOC clusters, the source cluster tiered storage bucket name follows the pattern: `redpanda-cloud-storage-$\{SOURCE_CLUSTER_ID}`
96+
- For `<topic_name>`, use the same name as the original topic.
97+
- For `<source-cluster-bucket-name>`, use the bucket specified in the `cloud_storage_bucket` properties for the origin cluster.
98+
99+
For standard BYOC clusters, the source cluster bucket name follows the pattern: `redpanda-cloud-storage-${SOURCE_CLUSTER_ID}`
100+
101+
[[create-cross-region-rrr-topic]]
102+
=== Create a cross-region remote read replica topic on AWS
103+
104+
Use this configuration only when the remote cluster is in a *different AWS region* than the origin cluster's S3 bucket. For same-region AWS or GCP deployments, use the standard <<Create remote read replica topic,topic creation command>>.
105+
106+
==== Create the topic
107+
108+
To create a cross-region remote read replica topic, append `region` and `endpoint` query-string parameters to the bucket name.
109+
110+
In the following example, replace the placeholders:
111+
112+
- `<topic_name>`: The name of the topic in the cluster hosting the remote read replica.
113+
- `<bucket_name>`: The S3 bucket configured on the origin cluster (`cloud_storage_bucket`).
114+
- `<origin_bucket_region>`: The AWS region of the origin cluster's S3 bucket (not the remote cluster's region).
115+
116+
[,bash]
117+
----
118+
rpk topic create <topic_name> \
119+
-c redpanda.remote.readreplica=<bucket_name>?region=<origin_bucket_region>&endpoint=s3.<origin_bucket_region>.amazonaws.com
120+
--tls-enabled
121+
----
122+
123+
For example, if the origin cluster stores data in a bucket called `my-bucket` in `us-east-1`:
124+
125+
[,bash]
126+
----
127+
rpk topic create my-topic \
128+
-c redpanda.remote.readreplica=my-bucket?region=us-east-1&endpoint=s3.us-east-1.amazonaws.com
129+
--tls-enabled
130+
----
131+
132+
NOTE: The `endpoint` value must not include the bucket name. When using `virtual_host` URL style, Redpanda automatically prepends the bucket name to the endpoint. When using `path` URL style, Redpanda appends the bucket name as a path segment.
133+
134+
==== Limits
135+
136+
Each unique combination of region and endpoint creates a separate object storage target on the remote cluster. A cluster supports a maximum of 10 targets.
137+
138+
How targets are counted depends on `cloud_storage_url_style`:
139+
140+
- `virtual_host`: Each unique combination of bucket, region, and endpoint counts as one target. You can create up to 10 distinct cross-region remote read replica topics for each cluster.
141+
- `path`: Each unique combination of region and endpoint counts as one target (the bucket name is not part of the key). You can create cross-region remote read replica topics for multiple buckets using the same region/endpoint combination, with a maximum of 10 distinct region/endpoint combinations for each cluster.
96142

97143
== Optional: Tune for live topics
98144

modules/get-started/pages/cluster-types/serverless.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -108,5 +108,5 @@ Not all features included in BYOC clusters are available in Serverless. For exam
108108
* xref:networking:serverless/aws/index.adoc[Set up private access for Serverless clusters]
109109
* xref:manage:terraform-provider.adoc[Manage Redpanda Cloud with Terraform]
110110
* xref:get-started:cloud-overview.adoc[Learn more about Redpanda Cloud]
111-
* xref:get-started:config-topics.adoc[Manage topics]
111+
* xref:develop:topics/config-topics.adoc[Manage topics]
112112
* xref:billing:billing.adoc[Learn about billing]

modules/get-started/pages/whats-new-cloud.adoc

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,20 @@ This page lists new features added to Redpanda Cloud.
88

99
== March 2026
1010

11+
=== Cloud Topics
12+
13+
xref:develop:topics/cloud-topics.adoc[Cloud Topics] are now available, making it possible to use durable cloud storage (S3, ADLS, GCS) as the primary backing store instead of local disk, eliminating over 90% of cross-AZ replication costs. This makes them ideal for latency-tolerant, high-throughput workloads such as observability streams, analytics pipelines, and AI/ML training data feeds, where cross-AZ networking charges are the dominant cost driver.
14+
15+
You can use Cloud Topics exclusively in Redpanda Streaming clusters, or in combination with standard topics on a shared cluster supporting low-latency workloads.
16+
17+
=== User-based throughput quotas
18+
19+
Redpanda now supports throughput quotas based on authenticated user principals. Unlike client-based quotas (which rely on self-declared `client-id` values), xref:manage:cluster-maintenance/manage-throughput.adoc#set-user-based-quotas[user-based quotas] enforce limits using verified identities from SASL, mTLS, or OIDC authentication. You can set quotas for individual users, default users, or fine-grained user/client combinations.
20+
21+
=== Ordered rack preference for leader pinning
22+
23+
xref:develop:produce-data/leader-pinning.adoc[Leader pinning] now supports the `ordered_racks` configuration value, which lets you specify preferred racks in priority order. Unlike `racks`, which distributes leaders uniformly across all listed racks, `ordered_racks` places leaders in the highest-priority available rack and fails over to subsequent racks only when higher-priority racks become unavailable.
24+
1125
=== BYOVPC on AWS: GA
1226

1327
xref:get-started:cluster-types/byoc/aws/vpc-byo-aws.adoc[BYOVPC on AWS] is now generally available (GA). With Bring Your Own VPC (BYOVPC), you deploy the Redpanda data plane into your own VPC and manage security policies and resources yourself, including subnets, IAM roles, firewall rules, and storage buckets. The Redpanda BYOVPC Terraform Module contains Terraform code that deploys the resources required for a BYOVPC cluster on AWS. Secrets management is enabled by default with the Terraform module.
@@ -108,7 +122,7 @@ You can view details about Kafka client connections using `rpk` or the Data Plan
108122

109123
=== Increased message size limit
110124

111-
Redpanda Cloud increased the xref:get-started:create-topic.adoc[message size limit] on newly-created topics. BYOC and Dedicated clusters have a default message size limit of 20 MiB with a maximum of 32 MiB. Serverless clusters have a default message size limit of 8 MiB with a maximum of 20 MiB. Configure the message size limit with the `max_message_bytes` topic property.
125+
Redpanda Cloud increased the xref:develop:topics/create-topic.adoc[message size limit] on newly-created topics. BYOC and Dedicated clusters have a default message size limit of 20 MiB with a maximum of 32 MiB. Serverless clusters have a default message size limit of 8 MiB with a maximum of 20 MiB. Configure the message size limit with the `max_message_bytes` topic property.
112126

113127
The message size setting on existing topics is not changed, but the message size limit on existing topics can only be updated to the new maximum.
114128

0 commit comments

Comments
 (0)