Skip to content

Fix Sample jobs bug fixes#30

Open
gopi-databricks wants to merge 2 commits intomainfrom
feature/sample-jobs-error-fix
Open

Fix Sample jobs bug fixes#30
gopi-databricks wants to merge 2 commits intomainfrom
feature/sample-jobs-error-fix

Conversation

@gopi-databricks
Copy link
Copy Markdown
Collaborator

Fixes: #29

Issue:

Below sample jobs are failing currently:

  1. Lakeflow Framework Samples - Run 1 - Load and Schema Initialization
  2. Lakeflow Framework Samples - Run 2 - Load
  3. Lakeflow Framework Samples - Run 3 - Load
  4. Lakeflow Framework Samples - Run 4 - Load

What changes made?

  1. Added schema_namespace param in the job resources YAML file to handle [TABLE_OR_VIEW_NOT_FOUND] error.
  2. Added a new shell function to update global config file table_migration_volume path variable during deployment. At the end of the deployment, the global.json file will be reverted back (follows same pattern as updating substitution files). This fixes the error PERMISSION_DENIED: User does not have READ VOLUME on Volume stg_volume

Test:

Deployed the changes in databricks workspace. Below are the successful runs for reference

  1. Lakeflow Framework Samples - Run 1 - Load and Schema Initialization
  2. Lakeflow Framework Samples - Run 2 - Load
  3. Lakeflow Framework Samples - Run 3 - Load
  4. Lakeflow Framework Samples - Run 4 - Load

@gopi-databricks gopi-databricks requested a review from haillew April 10, 2026 11:46
@gopi-databricks gopi-databricks self-assigned this Apr 10, 2026
@gopi-databricks gopi-databricks added the bug Something isn't working label Apr 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG]: Failures in the lakeflow framework samples jobs

2 participants