You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The shadow cluster operates in read-only mode while continuously receiving updates from the source cluster. During a disaster, you can failover individual topics or an entire shadow link to make resources fully writable for production traffic. See xref:deploy:redpanda/manual/disaster-recovery/shadowing/failover-runbook.adoc[] for emergency procedures.
21
21
22
+
22
23
== Connected client monitoring
23
24
24
25
You can view details about Kafka client connections using `rpk` or the Admin API ListKafkaConnections endpoint. This allows you to view detailed information about active client connections on a cluster, and identify and troubleshoot problematic clients. For more information, see the xref:manage:cluster-maintenance/manage-throughput.adoc#view-connected-client-details[connected client details] example in the Manage Throughput guide.
@@ -49,10 +50,23 @@ You can now generate a security report for your Redpanda cluster using the link:
49
50
50
51
Redpanda v25.3 implements topic identifiers using 16 byte UUIDs as proposed in https://cwiki.apache.org/confluence/display/KAFKA/KIP-516%3A+Topic+Identifiers[KIP-516^].
51
52
52
-
== New rpk commands
53
+
== New commands
54
+
55
+
Redpanda v25.3 introduces new xref:reference:rpk/rpk-shadow/rpk-shadow.adoc[`rpk shadow`] commands for managing Redpanda shadow links:
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-list.adoc[`rpk shadow list`], xref:reference:rpk/rpk-shadow/rpk-shadow-describe.adoc[`rpk shadow describe`], and xref:reference:rpk/rpk-shadow/rpk-shadow-status.adoc[`rpk shadow status`].
82
+
81
83
Verify that the following conditions exist before proceeding with failover:
82
84
83
85
* Shadow link state should be `ACTIVE`.
@@ -86,7 +88,7 @@ Verify that the following conditions exist before proceeding with failover:
86
88
87
89
**Understanding replication lag:**
88
90
89
-
Use `rpk shadow status <shadow-link-name>` to check lag, which shows the message count difference between source and shadow partitions:
91
+
Use xref:reference:rpk/rpk-shadow/rpk-shadow-status.adoc[`rpk shadow status`] to check lag, which shows the message count difference between source and shadow partitions:
90
92
91
93
* **Acceptable lag examples**: 0-1000 messages for low-throughput topics, 0-10000 messages for high-throughput topics
92
94
* **Concerning lag examples**: Growing lag over 50,000 messages, or lag that continuously increases without recovering
// TODO: Verify this output format by running actual rpk shadow status command
107
109
Example output showing healthy replication before failover:
108
110
----
109
-
Shadow Link: <shadow-link-name>
111
+
shadow link: <shadow-link-name>
110
112
111
113
Overview:
112
114
NAME <shadow-link-name>
@@ -139,6 +141,8 @@ A complete cluster failover is appropriate If you observe that the source cluste
139
141
rpk shadow failover <shadow-link-name> --all
140
142
----
141
143
144
+
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-failover.adoc[`rpk shadow failover`].
145
+
142
146
For selective topic failover (when only specific services are affected):
143
147
144
148
[,bash]
@@ -165,7 +169,7 @@ rpk shadow status <shadow-link-name> --print-topic
165
169
// TODO: Verify this output format by running actual rpk shadow status command during failover
166
170
Example output during successful failover:
167
171
----
168
-
Shadow Link: <shadow-link-name>
172
+
shadow link: <shadow-link-name>
169
173
170
174
Overview:
171
175
NAME <shadow-link-name>
@@ -217,6 +221,8 @@ After all applications are running normally:
217
221
rpk shadow delete <shadow-link-name>
218
222
----
219
223
224
+
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-delete.adoc[`rpk shadow delete`].
225
+
220
226
Document the time of failover initiation and completion, applications affected and recovery times, data loss estimates based on replication lag, and issues encountered during failover.
Use this approach when you need to selectively failover specific workloads or when testing failover procedures.
38
+
Use this approach when you need to selectively failover specific workloads or when testing failover procedures. For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-failover.adoc[`rpk shadow failover`].
39
39
40
40
=== Complete shadow link failover (cluster failover)
41
41
@@ -88,7 +88,7 @@ Monitor failover progress using the status command:
88
88
rpk shadow status <shadow-link-name>
89
89
----
90
90
91
-
The output shows individual topic states and any issues encountered during the failover process.
91
+
The output shows individual topic states and any issues encountered during the failover process. For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-status.adoc[`rpk shadow status`].
Copy file name to clipboardExpand all lines: modules/manage/pages/disaster-recovery/shadowing/monitor.adoc
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,6 +28,8 @@ View shadow link configuration details:
28
28
rpk shadow describe <my-disaster-recovery-link>
29
29
----
30
30
31
+
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-list.adoc[`rpk shadow list`] and xref:reference:rpk/rpk-shadow/rpk-shadow-describe.adoc[`rpk shadow describe`].
32
+
31
33
This command shows the complete configuration of the shadow link, including connection settings, filters, and synchronization options.
32
34
33
35
Check your shadow link status to ensure proper operation:
@@ -44,7 +46,7 @@ rpk shadow status <shadow-link-name>
44
46
rpk shadow status <shadow-link-name>
45
47
----
46
48
47
-
For troubleshooting specific issues, you can use command options to show individual status sections. See the rpk reference for available status options.
49
+
For troubleshooting specific issues, you can use command options to show individual status sections. See xref:reference:rpk/rpk-shadow/rpk-shadow-status.adoc[`rpk shadow status`] for available status options.
This creates a template configuration file that you can customize for your environment.
279
+
This creates a template configuration file that you can customize for your environment. For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-config-generate.adoc[`rpk shadow config generate`].
280
280
281
281
=== Networking
282
282
@@ -374,6 +374,8 @@ You can establish a shadow link using either xref:get-started:rpk/index.adoc[`rp
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-create.adoc[`rpk shadow create`].
378
+
377
379
=== Update an existing shadow link
378
380
379
381
If you need to modify a shadow link configuration after creation, use the update command:
@@ -383,6 +385,8 @@ If you need to modify a shadow link configuration after creation, use the update
383
385
rpk shadow update <shadow-link-name>
384
386
----
385
387
388
+
For detailed command options, see xref:reference:rpk/rpk-shadow/rpk-shadow-update.adoc[`rpk shadow update`].
389
+
386
390
This opens your default editor to modify the shadow link configuration. Only changed fields are updated on the server. The shadow link name cannot be changed - you must delete and recreate the link to rename it.
Generate a configuration file for creating a shadow link.
5
+
6
+
By default, this command creates a sample configuration file with placeholder values that you customize for your environment.
7
+
8
+
Use the `--print-template` flag to generate a configuration template with detailed field documentations.
9
+
10
+
By default, this command prints the configuration to standard output. Use the `--output` flag to save the configuration to a file.
11
+
12
+
After you generate the configuration file, update the placeholder values with your actual connection details and settings. Then use xref:reference:rpk/rpk-shadow/rpk-shadow-create.adoc[`rpk shadow create`] to create the shadow link.
13
+
14
+
== Usage
15
+
16
+
[,bash]
17
+
----
18
+
rpk shadow config generate [flags]
19
+
----
20
+
21
+
== Examples
22
+
23
+
Generate a sample configuration and print it to standard output:
24
+
[,bash]
25
+
----
26
+
rpk shadow config generate
27
+
----
28
+
29
+
Generate a configuration template with all the field documentation:
|-o, --output |string |File path identifying where to save the generated configuration file. If not specified, prints to standard output.
57
+
58
+
|--print-template |- |Generate a configuration template with field documentation instead of a sample configuration.
59
+
60
+
|-h, --help |- |Help for generate.
61
+
62
+
|--config |string |Redpanda or `rpk` config file; default search paths are `/var/lib/redpanda/.config/rpk/rpk.yaml`, `$PWD/redpanda.yaml`, and `/etc/redpanda/redpanda.yaml`.
63
+
64
+
|-X, --config-opt |stringArray |Override `rpk` configuration settings. See xref:reference:rpk/rpk-x-options.adoc[`rpk -X`] or execute `rpk -X help` for inline detail or `rpk -X list` for terser detail.
65
+
66
+
|--profile |string |Profile to use. See xref:reference:rpk/rpk-profile.adoc[`rpk profile`] for more details.
This command creates a shadow link using a configuration file that defines the connection details and synchronization settings.
7
+
8
+
Before you create a shadow link, generate a configuration file with xref:reference:rpk/rpk-shadow/rpk-shadow-config-generate.adoc[`rpk shadow config generate`] and update it with your source cluster details. The command prompts you to confirm the creation. Use the `--no-confirm` flag to skip the confirmation prompt.
9
+
10
+
After you create the shadow link, use xref:reference:rpk/rpk-shadow/rpk-shadow-status.adoc[`rpk shadow status`] to monitor the replication progress.
11
+
12
+
== Usage
13
+
14
+
[,bash]
15
+
----
16
+
rpk shadow create [flags]
17
+
----
18
+
19
+
== Examples
20
+
21
+
Create a shadow link using a configuration file:
22
+
23
+
[,bash]
24
+
----
25
+
rpk shadow create --config-file shadow-link.yaml
26
+
----
27
+
28
+
Create a shadow link without a confirmation prompt:
|-c, --config-file |string |Path to configuration file to use for the shadow link; use `--help` for details.
42
+
43
+
|--no-confirm |- |Disable confirmation prompt.
44
+
45
+
|-h, --help |- |Help for create.
46
+
47
+
|--config |string |Redpanda or `rpk` config file; default search paths are `/var/lib/redpanda/.config/rpk/rpk.yaml`, `$PWD/redpanda.yaml`, and `/etc/redpanda/redpanda.yaml`.
48
+
49
+
|-X, --config-opt |stringArray |Override `rpk` configuration settings. See xref:reference:rpk/rpk-x-options.adoc[`rpk -X`] or execute `rpk -X help` for inline detail or `rpk -X list` for terser detail.
50
+
51
+
|--profile |string |Profile to use. See xref:reference:rpk/rpk-profile.adoc[`rpk profile`] for more details.
This command deletes a shadow link by name. By default, you cannot delete a shadow link that has active shadow topics. Use xref:reference:rpk/rpk-shadow/rpk-shadow-failover.adoc[`rpk shadow failover`] first to deactivate topics before deletion, or use the `--force` flag to delete the shadow link and failover all its active shadow topics.
7
+
8
+
The command prompts you to confirm the deletion. Use the `--no-confirm` flag to skip the confirmation prompt. The `--force` flag automatically disables the confirmation prompt.
9
+
10
+
WARNING: Deleting a shadow link with `--force` permanently removes all shadow topics and stops replication. This operation cannot be undone.
11
+
12
+
== Usage
13
+
14
+
[,bash]
15
+
----
16
+
rpk shadow delete [LINK_NAME] [flags]
17
+
----
18
+
19
+
== Examples
20
+
21
+
Delete a shadow link:
22
+
23
+
[,bash]
24
+
----
25
+
rpk shadow delete my-shadow-link
26
+
----
27
+
28
+
Delete a shadow link without confirmation:
29
+
30
+
[,bash]
31
+
----
32
+
rpk shadow delete my-shadow-link --no-confirm
33
+
----
34
+
35
+
Force delete a shadow link with active shadow topics:
36
+
37
+
[,bash]
38
+
----
39
+
rpk shadow delete my-shadow-link --force
40
+
----
41
+
42
+
== Flags
43
+
44
+
[cols="1m,1a,2a"]
45
+
|===
46
+
|*Value* |*Type* |*Description*
47
+
48
+
|-f, --force |- |If set, forces a delete while there are active shadow topics; disables confirmation prompts as well.
49
+
50
+
|--no-confirm |- |Disable confirmation prompt.
51
+
52
+
|-h, --help |- |Help for delete.
53
+
54
+
|--config |string |Redpanda or `rpk` config file; default search paths are `/var/lib/redpanda/.config/rpk/rpk.yaml`, `$PWD/redpanda.yaml`, and `/etc/redpanda/redpanda.yaml`.
55
+
56
+
|-X, --config-opt |stringArray |Override `rpk` configuration settings. See xref:reference:rpk/rpk-x-options.adoc[`rpk -X`] or execute `rpk -X help` for inline detail or `rpk -X list` for terser detail.
57
+
58
+
|--profile |string |Profile to use. See xref:reference:rpk/rpk-profile.adoc[`rpk profile`] for more details.
0 commit comments