Skip to content

KCL metrics management through config#6361

Open
RashmiRam wants to merge 4 commits into
opensearch-project:mainfrom
RashmiRam:kinesis-source-metrics-config
Open

KCL metrics management through config#6361
RashmiRam wants to merge 4 commits into
opensearch-project:mainfrom
RashmiRam:kinesis-source-metrics-config

Conversation

@RashmiRam
Copy link
Copy Markdown
Contributor

Description

1.Added "metrics" config to disable/enable sending KCL metrics to cloudwatch
2.Default value is false.

Issues Resolved

Resolves #6360

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
  • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link
Copy Markdown
Member

@dlvenable dlvenable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @RashmiRam for this contribution. I have one comment.

Also, the DCO is failing. Please see the failing build for information and instructions on how to fix: https://github.com/opensearch-project/data-prepper/pull/6361/checks?check_run_id=58389994642


@Getter
@JsonProperty("metrics")
private boolean metrics = false;
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The existing configuration appears to include these metrics. So we must make the default consistent with the current behavior.

Also, we should express this as disabling rather than enabling. And we should clarify what metrics are disabled. There are more than KCL metrics, so the current name can be confusing.

I propose this configuration:

disable_client_metrics: true

or

disable_kcl_metrics: true

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

1.Added "metrics" config to disable/enable sending KCL metrics to cloudwatch
2.Default value is false.

Signed-off-by: RashmiRam <ras.xena@gmail.com>
@RashmiRam RashmiRam force-pushed the kinesis-source-metrics-config branch from dea83ca to 2a54f6b Compare January 21, 2026 04:46
@RashmiRam
Copy link
Copy Markdown
Contributor Author

Thank you @RashmiRam for this contribution. I have one comment.

Also, the DCO is failing. Please see the failing build for information and instructions on how to fix: https://github.com/opensearch-project/data-prepper/pull/6361/checks?check_run_id=58389994642

Done.

Signed-off-by: Rashmi <ras.xena@gmail.com>
@RashmiRam RashmiRam requested a review from dlvenable January 21, 2026 11:57
Signed-off-by: RashmiRam <ras.xena@gmail.com>
@RashmiRam
Copy link
Copy Markdown
Contributor Author

@dlvenable Looks like these tests failures doesn't have anything to do with the changes that I have made. Can you please help me proceed further on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Metrics pushing from KCL based on config

2 participants