Skip to content

[kafka] Surface Kafka Monitoring above the fold in the integration README #23710

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
johannbotha merged 4 commits into from
May 18, 2026
Merged

[kafka] Surface Kafka Monitoring above the fold in the integration README #23710

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
2489038
[kafka] Add Data Streams Monitoring callout above the fold
johannbotha May 14, 2026
024de48
Drop italic block on Kafka README callout
johannbotha May 14, 2026
d4e3dbe
[kafka] Consolidate DSM mentions into a single top-of-page callout
johannbotha May 18, 2026
fbcd278
Drop inline HTML; use plain markdown for Kafka Monitoring callout
johannbotha May 18, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 3 additions & 6 deletions kafka/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,12 @@

![Kafka Dashboard][1]

**New:** [Kafka Monitoring][24] tracks consumer lag, throughput, schemas, and adds message reading capabilities.

## Overview

View Kafka broker metrics and logs for a 360-view of the health and performance of your Kafka clusters in real time.

Add [Data Streams Monitoring][24] to your producers and consumers to visualize the application topology, root cause issues across services, and measure end to end latency, throughput and lag.

**Note**:

- This check has a limit of 350 metrics per instance. The number of returned metrics is indicated in the Agent status output. Specify the metrics you are interested in by editing the configuration below. For more detailed instructions on customizing the metrics to collect, see the
Expand All @@ -25,8 +25,6 @@ To collect Kafka consumer metrics, see the [kafka_consumer check][3].

The Agent's Kafka check is included in the [Datadog Agent][4] package, no additional installation is needed on your Kafka nodes.

Add [Data Streams Monitoring][24] to your producers and consumers to visualize the application topology, root cause issues across services, and measure end to end latency, throughput and lag.

@labbati labbati May 26, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the rationale for removing all classic DSM links? Save real estate?

@johannbotha johannbotha May 26, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO having multiple callouts to DSM will reduce the efficacy of either callout. The callout that is most applicable here is the callout to kafka monitoring so I decided to make that one more prominent .


The check collects metrics from JMX with [JMXFetch][5]. A JVM is needed on each kafka node so the Agent can run JMXFetch. The same JVM that Kafka uses can be used for this.

**Note**: The Kafka check cannot be used with Managed Streaming for Apache Kafka (Amazon MSK). Use the [Amazon MSK integration][6] instead.
Expand Down Expand Up @@ -184,5 +182,4 @@ See [service_checks.json][15] for a list of service checks provided by this inte
[21]: https://www.datadoghq.com/blog/monitor-kafka-with-datadog
[22]: https://raw.githubusercontent.com/DataDog/dd-agent/5.2.1/conf.d/kafka.yaml.example
[23]: https://www.datadoghq.com/knowledge-center/apache-kafka/
[24]: https://docs.datadoghq.com/data_streams/
[25]: /data-streams
[24]: https://docs.datadoghq.com/data_streams/kafka?utm_source=docs&utm_medium=callout&utm_campaign=DocsCTA-DSMKafka-IntegrationsKafka
Loading