AssertionError: Workflow failed: migrate-external-tables-ctas
assert False
[gw4] linux -- Python 3.10.20 /home/runner/work/ucx/ucx/.venv/bin/python
06:40 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh/config.yml) doesn't exist.
06:40 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:40 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
06:40 INFO [databricks.labs.ucx.install] Fetching installations...
06:40 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh is corrupted. Skipping...
06:40 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:40 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:40 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:40 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+1220260609064007
06:40 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:40 INFO [databricks.labs.ucx.install] Creating dashboards...
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh/README for the next steps.
06:40 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:40 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/248689248073746
06:40 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:40 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/248689248073746/runs/287928136238002
06:40 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/248689248073746
06:40 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:51 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/975168761509319
06:51 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-tables-ctas job: None
06:51 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/975168761509319/runs/503615869229418
06:51 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-tables-ctas workflow: https://DATABRICKS_HOST#job/975168761509319
06:51 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:40 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh/config.yml) doesn't exist.
06:40 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:40 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
06:40 INFO [databricks.labs.ucx.install] Fetching installations...
06:40 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh is corrupted. Skipping...
06:40 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:40 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:40 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:40 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+1220260609064007
06:40 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:40 INFO [databricks.labs.ucx.install] Creating dashboards...
06:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:40 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:40 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:40 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EiQh/README for the next steps.
06:40 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:40 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/248689248073746
06:40 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:40 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/248689248073746/runs/287928136238002
06:40 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/248689248073746
06:40 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:51 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/975168761509319
06:51 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-tables-ctas job: None
06:51 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/975168761509319/runs/503615869229418
06:51 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-tables-ctas workflow: https://DATABRICKS_HOST#job/975168761509319
06:51 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
07:11 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+1220260609064007 from https://DATABRICKS_HOST
07:11 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sruox1jjy
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=995818477262929, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=490722306627819, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=422335735179345, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1063236787061446, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=932551558590348, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1019250451184634, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=248689248073746, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=223202509245056, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=975168761509319, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=664120893213896, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=31758848620758, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=800227843408082, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=798379632432101, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=541869199269843, as it is no longer needed
07:11 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1065914465851699, as it is no longer needed
07:11 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:11 INFO [databricks.labs.ucx.install] Deleting secret scope
07:11 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw4] linux -- Python 3.10.20 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: AssertionError: Workflow failed: migrate-external-tables-ctas (32m18.763s)
Running from nightly #877