Skip to content

[Dataflow Java] Clarify which portions of DataflowWorkerLoggingOptions are deprecated - #38960

Merged
scwhittle merged 2 commits into
apache:masterfrom
scwhittle:clarify_deprecation
Jun 16, 2026
Merged

[Dataflow Java] Clarify which portions of DataflowWorkerLoggingOptions are deprecated#38960
scwhittle merged 2 commits into
apache:masterfrom
scwhittle:clarify_deprecation

Conversation

@scwhittle

Copy link
Copy Markdown
Contributor

Specifically point out which fields should be used in SdkHarnessOptions

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request improves the documentation and deprecation strategy for DataflowWorkerLoggingOptions. By explicitly marking individual methods as deprecated and providing clear guidance on using SdkHarnessOptions, it ensures that developers are directed toward more portable and forward-compatible configuration options for worker logging.

Highlights

  • Deprecation Clarification: Updated the Javadoc for DataflowWorkerLoggingOptions to clarify that specific fields are deprecated in favor of SdkHarnessOptions.
  • API Annotations: Added @deprecated annotations to individual methods within DataflowWorkerLoggingOptions to guide users toward cross-runner compatible alternatives.
New Features

🧠 You can now enable Memory (public preview) to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize the Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counterproductive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors DataflowWorkerLoggingOptions by removing the deprecation from the entire interface and instead deprecating individual logging option getters, pointing users to SdkHarnessOptions equivalents. The review feedback suggests improving the Javadoc formatting by using proper {@link} tags for the recommended replacements and ensuring that corresponding setter methods are also marked with @deprecated to maintain consistency.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

* */
@Description("Controls the default log level of all loggers without a log level override.")
@Default.Enum("INFO")
@Deprecated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

When deprecating a property in a PipelineOptions interface, both the getter and the setter should be deprecated to ensure consistent compiler warnings. Please also add @Deprecated to setDefaultWorkerLogLevel(Level level).

+ "message may be filtered depending on the defaultWorkerLogLevel or if a 'System.out' "
+ "override is specified via workerLogLevelOverrides.")
@Default.Enum("INFO")
@Deprecated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Please also deprecate the corresponding setter setWorkerSystemOutMessageLevel(Level level) with @Deprecated to ensure consistency.

+ "message may be filtered depending on the defaultWorkerLogLevel or if a 'System.err' "
+ "override is specified via workerLogLevelOverrides.")
@Default.Enum("ERROR")
@Deprecated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Please also deprecate the corresponding setter setWorkerSystemErrMessageLevel(Level level) with @Deprecated to ensure consistency.

+ "level. System.out and System.err levels are configured via loggers of the corresponding "
+ "name. Also, note that when multiple overrides are specified, the exact name followed by "
+ "the closest parent takes precedence.")
@Deprecated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Please also deprecate the corresponding setter setWorkerLogLevelOverrides(WorkerLogLevelOverrides value) with @Deprecated to ensure consistency.

…s are deprecated in preference of equivalent fields in SdkHarnessOptions
@scwhittle
scwhittle force-pushed the clarify_deprecation branch from 4175438 to 8796ed9 Compare June 15, 2026 11:16
@github-actions

Copy link
Copy Markdown
Contributor

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

@scwhittle

Copy link
Copy Markdown
Contributor Author

/gemini review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates DataflowWorkerLoggingOptions by removing the deprecation annotation from the interface itself and instead deprecating all of its individual methods, directing users to use SdkHarnessOptions for cross-runner compatibility. The reviewer suggested updating the class-level Javadoc to clarify that all options in the interface are deprecated, rather than just 'some' of them.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

@scwhittle

Copy link
Copy Markdown
Contributor Author

test failures are unrelated spark test issue

@scwhittle

Copy link
Copy Markdown
Contributor Author

assign set of reviewers

@github-actions

Copy link
Copy Markdown
Contributor

Assigning reviewers:

R: @tvalentyn added as fallback since no labels match configuration

Note: If you would like to opt out of this review, comment assign to next reviewer.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

@scwhittle
scwhittle merged commit 2c53494 into apache:master Jun 16, 2026
20 of 22 checks passed
@scwhittle
scwhittle deleted the clarify_deprecation branch June 16, 2026 18:30
ash6898 pushed a commit to ash6898/beam that referenced this pull request Jun 28, 2026
…s are deprecated (apache#38960)

Clarify which portions of DataflowWorkerLoggingOptions are deprecated in preference of equivalent fields in SdkHarnessOptions
ash6898 pushed a commit to ash6898/beam that referenced this pull request Jun 29, 2026
…s are deprecated (apache#38960)

Clarify which portions of DataflowWorkerLoggingOptions are deprecated in preference of equivalent fields in SdkHarnessOptions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants