Skip to content

OBSDATA-13340 Add monitor to find length of queue at Routers#19354

Open
ravisharm wants to merge 61 commits intoapache:30.0.1from
confluentinc:OBSDATA-13340
Open

OBSDATA-13340 Add monitor to find length of queue at Routers#19354
ravisharm wants to merge 61 commits intoapache:30.0.1from
confluentinc:OBSDATA-13340

Conversation

@ravisharm
Copy link
Copy Markdown

Fixes #XXXX.

Description

Fixed the bug ...

Renamed the class ...

Added a forbidden-apis entry ...

Release note


Key changed/added classes in this PR
  • MyFoo
  • OurBar
  • TheirBaz

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

suraj-goel and others added 30 commits February 3, 2025 17:02
* Create patch for confluent changes on druid-25

* Add Fixes for patches

* Add changes related to channel acquire time metric.
#237

* Fix Checkstyle and other errors

* Fix Unit Test Cases

* Revert KafkaInputReader to latest

* Fix metricBuilder in MetricsEmittingMergingBlockingPool

* downgrade nimbus-jose-jwt version to 8.22.1 due to a known issue: apache#16920

* Fix cast to long in QueryResultPusher

* Fix CliPeonTest

Root Cause:
System properties are set by TestValidateIncompatibleCentralizedDatasourceSchemaConfig and since tests are running in parallel, injector was failing in CliPeonTest

* Cleanup QueryResultPusher

* Fix NumRowsScanned header value

* Run web console tests separately in semaphore

* Add Unit Test Cases

* Add T1C flag in Dockerfile and add assertions in KafkaInputFormatTest
* run "services" tests separately in semaphore

* Avoid local artifacts for running tests of "services"

* update command for "services" tests

* Run "services" tests sequentially

* pass params in MAVEN_OPTS

* fix MAVEN_OPTS in "Services"
…cient (#309)

* Add maxInterval to kill config and make kill tasks efficient

* resolve CI
* Column adding in druid-metric

* Changed to javadoc pattern

* Minor fix

* Checking

* Fixed checkstyle

* Added delayd_minutes

* double

* Removed redundant code

* Minor fix

* Test Case

* Removed reflection

* Fix for Class Error

* Minor fix

* New Interface

* Minor fix

* Checkstyle correction

* Dependency fix

* Renamed TimestampedEntity to KafkaEntity

* Local testing

* Dockerfile

* Checkstyle correction

* Modified Tests

* OBSDATA-9613 Run "services" tests separately on semaphore (#312)

* run "services" tests separately in semaphore

* Avoid local artifacts for running tests of "services"

* update command for "services" tests

* Run "services" tests sequentially

* pass params in MAVEN_OPTS

* fix MAVEN_OPTS in "Services"

* [OBSDATA-8872]Add maxInterval to kill config and make kill tasks efficient (#309)

* Add maxInterval to kill config and make kill tasks efficient

* resolve CI

* Reduce the poll duration for CoordinatorBasedSegmentHandoffNotifierConfig from 1M to 1S (#317)

* OBSDATA-9685 Add RDS root CA certs to Dockerfile (#319)

* Remove logic to disable "hard rest" and "set offsets" button when supervisor is in suspended state (#321)

* Modify "maxRowsInMemory"and "maxBytesInMemory" to use values from config (#323)

---------

Co-authored-by: Suraj Goel <sugoel@confluent.io>
Co-authored-by: Chetan Patidar <122344823+chetanpatidar26@users.noreply.github.com>
Co-authored-by: Rushikesh Bankar <67940386+rbankar7@users.noreply.github.com>
Co-authored-by: Sadananda Aithal <111732128+saithal-confluent@users.noreply.github.com>
* Upgrade async-http-client to fix CVE-2024-53990

* Upgrade kafka-client to fix CVE-2024-31141
* Upgrade hadoop-common to fix CVE-2024-23454

* Upgrade avro to fix CVE-2024-47561
* test: Revert semaphore build changes

* Use ubuntu-24

* Try using s1-prod-ubuntu24-04-amd64-3 instead of s1-prod-ubuntu24-04-amd64-1

* Set maven logging to INFO level to compare with Druid-25

* Enable debug logging for druid-30 bruids to compare with the druid-25 ones

* Remove maven debug logs and add quiet mode since we have all reqiured logs now
…#353)

* Update exec-maven-plugin version from 1.6.0 to 3.1.0

* Remove hadoop dependency

* Try out the pom.xml used for druid-v28.01

* Try adding back omitted extensions

* Add back more extensions
pinaki-basu and others added 10 commits November 4, 2025 00:37
…397)

* [OBSDATA-11562] Use hashmap in kafka header based inclusion feature (#385)

* Address comments in KafkaRecordSupplier

* Revert "Rename headerBasedFilterConfig config to headerBasedInclusionConfig (#382)"

This reverts commit c6505e4.

* Rename config to kafkaHeaderBasedFilterConfig

* Make addition of more filters extensible
…ng issues (apache#17351) (#409)

Co-authored-by: Akshat Jain <akjn11@gmail.com>
…18997) (#438)

(cherry picked from commit a57afa1)

Co-authored-by: jtuglu1 <jtuglu@netflix.com>
Co-authored-by: Cece Mei <yingqian.mei@gmail.com>
Backport of 34.0.0-confluent changes to 30.0.1-confluent.
Bakes AWS CLI v2 and async-profiler into the Docker image at build time
instead of downloading at runtime, eliminating supply chain risk.

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants