KIP-932: Add ShareConsumer support to soak tests#2230

Open

Ankith L (Ankith-Confluent) wants to merge 18 commits into

dev_kip-932_soak_tests

Commits on Jun 23, 2026

Add support for ShareConsumer in soak client and update usage instructionsx
Ankith L (Ankith-Confluent)
committed
Refactor share consumer metrics to use generic consumer counters in soak client
Ankith L (Ankith-Confluent)
committed
Update share consumer method from consume_batch to poll in SoakClient
Ankith L (Ankith-Confluent)
committed
Remove statistics configuration for ShareConsumer to prevent crashes
Ankith L (Ankith-Confluent)
committed
Add explicit mode support for ShareConsumer with alternating commit strategy
Ankith L (Ankith-Confluent)
committed
Refactor explicit mode handling in ShareConsumer to alternate between sync and async commits
Ankith L (Ankith-Confluent)
committed
Improve error logging for ShareConsumer commit_sync by detailing partition errors
Ankith L (Ankith-Confluent)
committed
Add script for perf testing with some metrics removed

Ojasva Jain (ojasvajain)
authored and
Ankith L (Ankith-Confluent)
committed
Enhance SoakRecord name generation to pad with base label for consistent serialized value size
Ankith L (Ankith-Confluent)
committed
Refactor SoakRecord name generation to use static padding for consistent serialized value size
Ankith L (Ankith-Confluent)
committed
Optimize performance by batching OTEL counter updates every 1000 messages in SoakClient
Ankith L (Ankith-Confluent)
committed
Disable on_delivery callback in SoakClient to reduce overhead during message production
Ankith L (Ankith-Confluent)
committed
Make poll non blocking in producer + batch multiple produce calls

Ojasva Jain (ojasvajain)
authored and
Ankith L (Ankith-Confluent)
committed
Optimize performance by updating OTEL counters per message and re-enabling per-message latency gauge in SoakClient
Ankith L (Ankith-Confluent)
committed
Increase static padding in SoakRecord for consistent serialized value size
Ankith L (Ankith-Confluent)
committed
Increase static padding in SoakRecord for improved serialized value size
Ankith L (Ankith-Confluent)
committed
Remove unused statistics configuration from SoakClient to prevent crashes
Ankith L (Ankith-Confluent)
committed
Remove 'enable.partition.eof' from ShareConsumer configuration to ensure compatibility with librdkafka v2.15.0-RC1
Ankith L (Ankith-Confluent)
committed