Skip to content

Prompt user to reconfigure reconcile on UC connections migration#2399

Open
m-abulazm wants to merge 1 commit intomainfrom
feat/recon/upgrade-config-prompt
Open

Prompt user to reconfigure reconcile on UC connections migration#2399
m-abulazm wants to merge 1 commit intomainfrom
feat/recon/upgrade-config-prompt

Conversation

@m-abulazm
Copy link
Copy Markdown
Contributor

@m-abulazm m-abulazm commented Apr 30, 2026

Changes

What does this PR do?

After migrating recon to Unity Catalog connections, old config with secret scopes are broken and need the config to be recreated with the connection. that scenario is detected during the install and the user is prompted if they want to configure reconcile and create the connection

Relevant implementation details

A deliberate choice of letting the user create the connection is implemented instead of silently creating the connection. As different sources need different create options and instead of owning that complexity, it is deferred to the product itself in databricks and user can follow the official docs

Caveats/things to watch out for when reviewing:

We don't check if the connection exists after the user enters it and that can be implemented in a subsequent PR if the resulting UX improvement is valid

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs install/upgrade lakebridge
  • ... +add your own

Tests

  • manually tested
  • added unit tests
  • added integration tests

@m-abulazm m-abulazm self-assigned this Apr 30, 2026
@m-abulazm m-abulazm added feat/recon making sure that remorphed query produces the same results as original stacked PR Should be reviewed, but not merged labels Apr 30, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 30, 2026

Codecov Report

❌ Patch coverage is 90.47619% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 65.84%. Comparing base (ae2c29b) to head (1de2023).

Files with missing lines Patch % Lines
src/databricks/labs/lakebridge/install.py 90.47% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2399      +/-   ##
==========================================
+ Coverage   65.78%   65.84%   +0.05%     
==========================================
  Files          98       98              
  Lines        9237     9258      +21     
  Branches      992      995       +3     
==========================================
+ Hits         6077     6096      +19     
- Misses       2984     2985       +1     
- Partials      176      177       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 30, 2026

✅ 148/148 passed, 5 skipped, 22m52s total

Running from acceptance #4261

@m-abulazm m-abulazm marked this pull request as ready for review April 30, 2026 18:09
@m-abulazm m-abulazm requested a review from a team as a code owner April 30, 2026 18:09
@m-abulazm m-abulazm force-pushed the feat/recon/upgrade-config-prompt branch from c27b0da to e38d515 Compare May 1, 2026 05:36
@m-abulazm m-abulazm force-pushed the feat/recon/upgrade-config-prompt branch from e38d515 to 81c5b1f Compare May 1, 2026 05:37
@m-abulazm m-abulazm requested a review from asnare May 1, 2026 05:50
@m-abulazm m-abulazm force-pushed the feat/recon/upgrade-config-prompt branch from 81c5b1f to 2ded0ac Compare May 1, 2026 07:10
Copy link
Copy Markdown
Contributor

@asnare asnare left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've had a quick skim, but my focus right now is on getting main all green. One thing that caught my eye on this is why the addition of those _ arguments on the tests?


@patch("webbrowser.open")
def test_configure_reconcile_no_existing_installation(ws: WorkspaceClient) -> None:
def test_configure_reconcile_no_existing_installation(_, ws: WorkspaceClient) -> None:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

_?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we patch webbrowser.open although we dont assert against it. The test method signature did not reflect that


@patch("webbrowser.open")
def test_configure_reconcile_databricks_no_existing_installation(ws: WorkspaceClient) -> None:
def test_configure_reconcile_databricks_no_existing_installation(_, ws: WorkspaceClient) -> None:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

… _ here as well?

Base automatically changed from feat/recon/query-uc-connections to main May 6, 2026 17:00
@m-abulazm m-abulazm force-pushed the feat/recon/upgrade-config-prompt branch from 10f317f to ab52979 Compare May 7, 2026 06:08
v1_migrate) and re-runs the reconcile configuration prompts so the user can supply the Unity Catalog connection name.
@m-abulazm m-abulazm force-pushed the feat/recon/upgrade-config-prompt branch from ab52979 to 1de2023 Compare May 7, 2026 06:09
@asnare asnare requested review from gueniai and sundarshankar89 May 7, 2026 07:47
@m-abulazm m-abulazm requested a review from asnare May 8, 2026 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feat/recon making sure that remorphed query produces the same results as original stacked PR Should be reviewed, but not merged

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants