Skip to content

Fix where stream scheduler could die from unexpected error for mongodb source#6638

Merged
graytaylor0 merged 2 commits into
opensearch-project:mainfrom
graytaylor0:Docdbfix
Mar 13, 2026
Merged

Fix where stream scheduler could die from unexpected error for mongodb source#6638
graytaylor0 merged 2 commits into
opensearch-project:mainfrom
graytaylor0:Docdbfix

Conversation

@graytaylor0

@graytaylor0 graytaylor0 commented Mar 13, 2026

Copy link
Copy Markdown
Member

Description

Fixes a failure scenario where giveUpPartition throwing exception would kill the stream scheduler thread, stopping stream processing on the data prepper instance.

When unexpected failures happen, catch the error and then do a full re-acquire attempt of the partition.

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…b source

Signed-off-by: Taylor Gray <tylgry@amazon.com>
dinujoh
dinujoh previously approved these changes Mar 13, 2026
Signed-off-by: Taylor Gray <tylgry@amazon.com>
@graytaylor0 graytaylor0 merged commit aaefdf3 into opensearch-project:main Mar 13, 2026
70 of 71 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants