Implement Asynchronous wrapper for DoFn in Java SDK#38609

Merged

damccorm merged 17 commits into

apache:masterfrom

tejasiyer-dev:add-async-dofn-wrapper

Jun 11, 2026

Commits on Jun 8, 2026

Created an Asynchronous Wrapper for DoFn as well as JUnit tests for the Apache Beam Java SDK (#38529)
tejasiyer-dev
committed
Optimize State reconciliation loop and eliminate O(N^2) complexity. Removed O(N) global activeElements scan. Fixed logic bug where duplicate elements were incorrectly marked for rescheduling. Optim…
tejasiyer-dev
committed
Added check for long overflow possibility when exponentially increasing sleep. Added two more tests to match Python SDK. Fixed formatting issues.
tejasiyer-dev
committed
Fix Timestamp propagation and add relevant test too. Spotless Apply fixes. Spot Bugs potential fixes.
tejasiyer-dev
committed
Resolve SpotBugs DMI_RANDOM_USED_ONLY_ONCE replacing new Random(seed) that preserves deterministic jitter behavior and avoids pressure on garbage collector (apache#38529)
tejasiyer-dev
committed
Improve AsyncDoFn robustness and fix critical warnings provided by gemini-code-assist
tejasiyer-dev
committed
Fixed formatting issue
tejasiyer-dev
committed
Implement cross-key task cancellation in AsyncDoFn.
tejasiyer-dev
committed
Passes original element's inputTimestamp to AccumulatingOutputReceiver to preserve event-time downstream. Initializes the ExecutorService thread pool only when useThreadPool is true. Refactors stat…
tejasiyer-dev
committed
Changed outputs from List type to ConcurrentLinkedQueue to prevent lock contention (#38529)
tejasiyer-dev
committed
Reverted outputs back to list type. Takes original Bounded Window as parameter without Hardcoding GlobalWindow.Instance (#38529)
tejasiyer-dev
committed
Refactor AsyncDoFn to simplify output receiver and fix type mismatches involving inputTimestamp(#38529)
tejasiyer-dev
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Implement Asynchronous wrapper for DoFn in Java SDK#38609

Implement Asynchronous wrapper for DoFn in Java SDK#38609
damccorm merged 17 commits into
apache:masterfrom
tejasiyer-dev:add-async-dofn-wrapper

Commits on Jun 8, 2026

Created an Asynchronous Wrapper for DoFn as well as JUnit tests for the Apache Beam Java SDK (#38529)

Optimize State reconciliation loop and eliminate O(N^2) complexity. Removed O(N) global activeElements scan. Fixed logic bug where duplicate elements were incorrectly marked for rescheduling. Optim…

Added check for long overflow possibility when exponentially increasing sleep. Added two more tests to match Python SDK. Fixed formatting issues.

Fix Timestamp propagation and add relevant test too. Spotless Apply fixes. Spot Bugs potential fixes.

Resolve SpotBugs DMI_RANDOM_USED_ONLY_ONCE replacing new Random(seed) that preserves deterministic jitter behavior and avoids pressure on garbage collector (apache#38529)

Improve AsyncDoFn robustness and fix critical warnings provided by gemini-code-assist

Fixed formatting issue

Implement cross-key task cancellation in AsyncDoFn.

Passes original element's inputTimestamp to AccumulatingOutputReceiver to preserve event-time downstream. Initializes the ExecutorService thread pool only when useThreadPool is true. Refactors stat…

Changed outputs from List type to ConcurrentLinkedQueue to prevent lock contention (#38529)

Reverted outputs back to list type. Takes original Bounded Window as parameter without Hardcoding GlobalWindow.Instance (#38529)

Refactor AsyncDoFn to simplify output receiver and fix type mismatches involving inputTimestamp(#38529)

Commits on Jun 9, 2026

Rename AsyncDoFn to PerKeyConcurrentDoFn to address naming feedback. Might also need to rename python sdk too.

Final Formatting fixes. (#38529)

Revert class, file, test naming back to AsyncDoFn. Extracted verbose ArgumentProvider code block into util functions. Refactored verbose logging into util functions. Replaced hardcoded numbers wit…

Commits on Jun 10, 2026

Rename class and files to AsyncWrapper and clean up old duplicates (#38529)

Refactor verbose logging to a single logInfo utility function (#38529)