Introduce checkpointing per shard to DDB source, via ShardAcknowledgementManager class#5818

Merged

graytaylor0 merged 14 commits into

opensearch-project:mainfrom

JonahCalvo:data-loss-bug

Jul 30, 2025

Commits on Jul 30, 2025

Implement checkpointing of dynamodb stream source
Jonah Calvo
committed
Fix unit tests
Jonah Calvo
committed
Do acknowledgements in batches per shard
Jonah Calvo
committed
Minor changes to respond to PR feedback
Jonah Calvo
committed
Better handling of failures during DDB acknowledgements
Jonah Calvo
committed
Update tracking of partitions to give up
Jonah Calvo
committed
Add license headers
Jonah Calvo
committed
Fix edge case where no records are received after initialization
Jonah Calvo
committed
Updated unit tests
Jonah Calvo
committed
Only start updating ownership if Ack manager exists
Jonah Calvo
committed
Fix shutdown logic in ack manager
Jonah Calvo
committed
Minor changes to unit tests
Jonah Calvo
committed
Minor change to fix build issue
Jonah Calvo
committed
revert change to build.gradle
Jonah Calvo
committed