Test failure: `test_running_real_assessment_job`

[github-actions]

❌ test_running_real_assessment_job: AssertionError: Workflow failed: assessment (18m44.528s)

AssertionError: Workflow failed: assessment
assert False
 +  where False = validate_step('assessment')
 +    where validate_step = <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7fb1df0c6560>.validate_step
 +      where <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7fb1df0c6560> = <tests.integration.conftest.MockInstallationContext object at 0x7fb1def91240>.deployed_workflows
[gw2] linux -- Python 3.10.20 /home/runner/work/ucx/ucx/.venv/bin/python
06:34 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.OyF3/config.yml) doesn't exist.
06:34 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:34 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
06:34 INFO [databricks.labs.ucx.install] Fetching installations...
06:34 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:34 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:38 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+1220260620063829
06:38 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:38 INFO [databricks.labs.ucx.install] Creating dashboards...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.OyF3/README for the next steps.
06:38 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/145715311743130
06:38 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:38 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/145715311743130/runs/170282187922486
06:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/145715311743130
06:38 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:34 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.OyF3/config.yml) doesn't exist.
06:34 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:34 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
06:34 INFO [databricks.labs.ucx.install] Fetching installations...
06:34 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:34 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:38 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+1220260620063829
06:38 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:38 INFO [databricks.labs.ucx.install] Creating dashboards...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.OyF3/README for the next steps.
06:38 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/145715311743130
06:38 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:38 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/145715311743130/runs/170282187922486
06:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/145715311743130
06:38 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:51 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+1220260620063829 from https://DATABRICKS_HOST
06:51 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_suz7isk2s
06:51 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=269432784937196, as it is no longer needed
06:51 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=145715311743130, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=113257267065739, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=33915931127224, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=999643662154954, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=230310251955799, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=106850860910884, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=135694963451046, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=289760232015441, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=953817967644777, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=801472333283178, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=576637478515995, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=962917324361868, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1025189930793600, as it is no longer needed
06:52 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=647817292746495, as it is no longer needed
06:52 INFO [databricks.labs.ucx.install] Deleting cluster policy
06:52 INFO [databricks.labs.ucx.install] Deleting secret scope
06:52 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw2] linux -- Python 3.10.20 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #888}

[github-actions]

❌ test_running_real_assessment_job: TimeoutError: timed out after 0:20:00: (44m12.437s)

... (skipped 30820221 bytes)
,
<       "node_type_id": "Standard_E2ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 7720497637237911808,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781036108501,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781036600696,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MDktMTc1NzEyLWZkamtxNzdsGjUKL2pvYi03NDc1Mjk1NTMzNTQ3MDgtcnVuLTQ3MTY4MDIwMjA5NDk4My1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MDktMjAxNTA4LTI4MDMwZzAwGi0KJ2pvYi03NDUzNjk2MDc5MzY1MzEtcnVuLTYxNTIxNDE0OTQyNjcyMxAGGAA="
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MDktMTc1NzEyLWZkamtxNzdsGjUKL2pvYi03NDc1Mjk1NTMzNTQ3MDgtcnVuLTQ3MTY4MDIwMjA5NDk4My1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0609-093216-96fjvnl0",
<       "cluster_name": "job-747533542921984-run-1003195794286946-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026060911",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+3220260609093200"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0609-093216-96fjvnl0",
<         "ClusterName": "job-747533542921984-run-1003195794286946-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "747533542921984",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[DUMMY-JCTYJWQS-RA78C33C6F] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1780997782103,
<       "last_restarted_time": 1780997824998,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 5150019620930107584,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1780997536239,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1780997906032,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTItMDYzMzI3LWZkMmw2OGU4GiwKJmpvYi03NDkzMDAyMDkxNjAzNjYtcnVuLTMwNDg0NDQ3MDQwNDg1EAYYAA==",
<   "prev_page_token": "CAESFDA2MDktMDkzMjE2LTk2Zmp2bmwwGjYKMGpvYi03NDc1MzM1NDI5MjE5ODQtcnVuLTEwMDMxOTU3OTQyODY5NDYtZGVm... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTItMDYzMzI3LWZkMmw2OGU4GiwKJmpvYi03NDkzMDAyMDkxNjAzNjYtcnVuLTMwNDg0NDQ3MDQwNDg1EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0625-235400-8lp9xedc",
<       "cluster_name": "job-749336993939404-run-779889652613378-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062601",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+5320260625235000"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0625-235400-8lp9xedc",
<         "ClusterName": "job-749336993939404-run-779889652613378-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "749336993939404",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[LET5] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782431832157,
<       "last_restarted_time": 1782431868252,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 4146672000055172551,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782431640573,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782431954633,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTUtMTcxNjUyLWhtMWp3cGhjGjUKL2pvYi03NTA0ODUzMjg3Mjk1MDEtcnVuLTk3OTgyMTQ5MTExODY5OS1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjUtMjM1NDAwLThscDl4ZWRjGjUKL2pvYi03NDkzMzY5OTM5Mzk0MDQtcnVuLTc3OTg4OTY1MjYxMzM3OC1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTUtMTcxNjUyLWhtMWp3cGhjGjUKL2pvYi03NTA0ODUzMjg3Mjk1MDEtcnVuLTk3OTgyMTQ5MTExODY5OS1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0628-055911-wr7gp0qo",
<       "cluster_name": "job-750493356421415-run-558964870396275-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062807",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+320260628055440"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0628-055911-wr7gp0qo",
<         "ClusterName": "job-750493356421415-run-558964870396275-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "750493356421415",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[UGWK] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782626457862,
<       "last_restarted_time": 1782626410289,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 3184845176577142140,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782626351887,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782626479151,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjUtMTI1MzI4LThobTdkcXRjGjUKL2pvYi03NTIwNDgwMzk0ODA1MTgtcnVuLTcyNjQzMzU3ODM4Mjc2MC1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjgtMDU1OTExLXdyN2dwMHFvGjUKL2pvYi03NTA0OTMzNTY0MjE0MTUtcnVuLTU1ODk2NDg3MDM5NjI3NS1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjUtMTI1MzI4LThobTdkcXRjGjUKL2pvYi03NTIwNDgwMzk0ODA1MTgtcnVuLTcyNjQzMzU3ODM4Mjc2MC1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0615-205402-3osb13pc",
<       "cluster_name": "job-752138881790653-run-323720885809951-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026061522",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+2520260615205344"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0615-205402-3osb13pc",
<         "ClusterName": "job-752138881790653-run-323720885809951-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "752138881790653",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[P8OM] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781556968259,
<       "last_restarted_time": 1781556913468,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 4107238497368095438,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781556842873,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781557003278,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTItMTkxMjQ2LW5oYzNqczNsGjUKL2pvYi03NTM0MDk5ODM1MTgxMDAtcnVuLTI5NjM1NjkyMTg3MjA1NC1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MTUtMjA1NDAyLTNvc2IxM3BjGjUKL2pvYi03NTIxMzg4ODE3OTA2NTMtcnVuLTMyMzcyMDg4NTgwOTk1MS1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTItMTkxMjQ2LW5oYzNqczNsGjUKL2pvYi03NTM0MDk5ODM1MTgxMDAtcnVuLTI5NjM1NjkyMTg3MjA1NC1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0608-192323-2tidkurl",
<       "cluster_name": "job-753425003050869-run-2833623024206-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026060821",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+1020260608192312"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0608-192323-2tidkurl",
<         "ClusterName": "job-753425003050869-run-2833623024206-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "753425003050869",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[CMV0] anomaly-trainer",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1780946729710,
<       "last_restarted_time": 1780946671496,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 295026738286761540,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1780946603618,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1780946740336,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjYtMjI0ODQxLWR0NXBwN25sGjUKL2pvYi03NTUxMjE1ODIwOTAwOS1ydW4tMTAyMTExMDgxNzg1NDM2NS1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MDgtMTkyMzIzLTJ0aWRrdXJsGjMKLWpvYi03NTM0MjUwMDMwNTA4NjktcnVuLTI4MzM2MjMwMjQyMDYtZGVmYXVs... (8 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjYtMjI0ODQxLWR0NXBwN25sGjUKL2pvYi03NTUxMjE1ODIwOTAwOS1ydW4tMTAyMTExMDgxNzg1NDM2NS1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0626-225110-yw3ynugw",
<       "cluster_name": "job-75512158209009-run-511650020744302-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062700",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+6120260626224821"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0626-225110-yw3ynugw",
<         "ClusterName": "job-75512158209009-run-511650020744302-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "75512158209009",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[HWJ1] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782514310048,
<       "last_restarted_time": 1782514339542,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 242468771824099611,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782514270162,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782514431675,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjQtMTgyOTExLWRrbXkzaDhnGjUKL2pvYi03NTY5NzY5MTg4NDAxOTQtcnVuLTQxODgzMzcwNzgzOTc5MS1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjYtMjI1MTEwLXl3M3ludWd3GjQKLmpvYi03NTUxMjE1ODIwOTAwOS1ydW4tNTExNjUwMDIwNzQ0MzAyLWRlZmF1... (8 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjQtMTgyOTExLWRrbXkzaDhnGjUKL2pvYi03NTY5NzY5MTg4NDAxOTQtcnVuLTQxODgzMzcwNzgzOTc5MS1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0612-142107-r3e5yygw",
<       "cluster_name": "job-757060567668647-run-788151018855930-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026061216",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+4820260612141614"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0612-142107-r3e5yygw",
<         "ClusterName": "job-757060567668647-run-788151018855930-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "757060567668647",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[DUMMY-AAKHQCHA-RA78C33DA0] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781274105956,
<       "last_restarted_time": 1781274139222,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 1785622911161748683,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781274068088,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781274222833,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MDgtMTQyMTU5LTl1eDFuM3N3GjQKLmpvYi03NTg2MjMyNjE3MTA5MjctcnVuLTMwOTEzNTgyMjQ0NTk4LWRlZmF1... (8 more bytes)",
<   "prev_page_token": "CAESFDA2MTItMTQyMTA3LXIzZTV5eWd3GjUKL2pvYi03NTcwNjA1Njc2Njg2NDctcnVuLTc4ODE1MTAxODg1NTkzMC1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MDgtMTQyMTU5LTl1eDFuM3N3GjQKLmpvYi03NTg2MjMyNjE3MTA5MjctcnVuLTMwOTEzNTgyMjQ0NTk4LWRlZmF1bHQQBhgA
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0620-061640-gxen7zsw",
<       "cluster_name": "job-758701061459387-run-119232132619034-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062008",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+120260620061149"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0620-061640-gxen7zsw",
<         "ClusterName": "job-758701061459387-run-119232132619034-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "758701061459387",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[MWXQ] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781936334381,
<       "last_restarted_time": 1781936269655,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 8842120406456171388,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781936201013,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781936352520,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjUtMTI0MTI0LXgyMGpuYmI0GjUKL2pvYi03NjAzNjAwNzMxNzc3ODAtcnVuLTg4Nzk2NDA2OTMxMTg3OC1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjAtMDYxNjQwLWd4ZW43enN3GjUKL2pvYi03NTg3MDEwNjE0NTkzODctcnVuLTExOTIzMjEzMjYxOTAzNC1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjUtMTI0MTI0LXgyMGpuYmI0GjUKL2pvYi03NjAzNjAwNzMxNzc3ODAtcnVuLTg4Nzk2NDA2OTMxMTg3OC1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0701-055538-32jwjegw",
<       "cluster_name": "job-760375470306271-run-981319134901768-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026070107",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+820260701055520"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0701-055538-32jwjegw",
<         "ClusterName": "job-760375470306271-run-981319134901768-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "760375470306271",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[M56D] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782885375539,
<       "last_restarted_time": 1782885404751,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 2893586064383310020,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782885339103,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782885484534,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjYtMTgwMTIwLXo2bzFmenN3Gj4KOGpvYi03NjExMjIxNTgxNjQwMDYtcnVuLTc0MzA3OTkyMTczNjM1MS1kcXhf... (24 more bytes)",
<   "prev_page_token": "CAESFDA3MDEtMDU1NTM4LTMyandqZWd3GjUKL2pvYi03NjAzNzU0NzAzMDYyNzEtcnVuLTk4MTMxOTEzNDkwMTc2OC1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjYtMTgwMTIwLXo2bzFmenN3Gj4KOGpvYi03NjExMjIxNTgxNjQwMDYtcnVuLTc0MzA3OTkyMTczNjM1MS1kcXhfZGVtb19jbHVzdGVyEAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0624-095311-eja2yc5c",
<       "cluster_name": "job-761199504305087-run-130857860528896-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062411",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+1720260624095248"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0624-095311-eja2yc5c",
<         "ClusterName": "job-761199504305087-run-130857860528896-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "761199504305087",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[WMRD] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782294825827,
<       "last_restarted_time": 1782294858251,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 8474827049559524763,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782294791837,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782294954043,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjUtMDcxMTA5LTVoMHh0ZHMwGjUKL2pvYi03NjMyNTc1NjExOTcyNDAtcnVuLTY5NzU3MjUyMDQ4MzU2Mi1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjQtMDk1MzExLWVqYTJ5YzVjGjUKL2pvYi03NjExOTk1MDQzMDUwODctcnVuLTEzMDg1Nzg2MDUyODg5Ni1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjUtMDcxMTA5LTVoMHh0ZHMwGjUKL2pvYi03NjMyNTc1NjExOTcyNDAtcnVuLTY5NzU3MjUyMDQ4MzU2Mi1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0630-115626-nedrnegw",
<       "cluster_name": "job-763324741257882-run-263565448961838",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026063013",
<         "ResourceClass": "SingleNode"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0630-115626-nedrnegw",
<         "ClusterName": "job-763324741257882-run-263565448961838",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "763324741257882",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "dqx_demo_library",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_E2ads_v6"
<       },
<       "driver_node_type_id": "Standard_E2ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_E2ads_v6"
<       },
<       "is_single_node": true,
<       "kind": "CLASSIC_PREVIEW",
<       "last_activity_time": 1782820969187,
<       "last_restarted_time": 1782820958674,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_E2ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 3793636671659316659,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782820587045,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782821087151,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjktMDgzNjE0LXk2YnJnYjljGjUKL2pvYi03NjQ5NTU4NzIxOTA5NjUtcnVuLTE0MjEyMTI2Nzk5NjkyOS1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MzAtMTE1NjI2LW5lZHJuZWd3Gi0KJ2pvYi03NjMzMjQ3NDEyNTc4ODItcnVuLTI2MzU2NTQ0ODk2MTgzOBAGGAA="
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjktMDgzNjE0LXk2YnJnYjljGjUKL2pvYi03NjQ5NTU4NzIxOTA5NjUtcnVuLTE0MjEyMTI2Nzk5NjkyOS1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0607-155308-krnd5wcg",
<       "cluster_name": "job-765006546498057-run-897635652286323-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026060717",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+4120260607155249"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0607-155308-krnd5wcg",
<         "ClusterName": "job-765006546498057-run-897635652286323-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "765006546498057",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[MG1L] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1780847634880,
<       "last_restarted_time": 1780847666715,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 8006579343800533018,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1780847588378,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1780847746595,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjItMTYyODU4LTB3OXdvbmI0GjUKL2pvYi03NjYyMDIwMDE5NTc3MzItcnVuLTg1MTMyMDkxNTkyMDA3Ny1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MDctMTU1MzA4LWtybmQ1d2NnGjUKL2pvYi03NjUwMDY1NDY0OTgwNTctcnVuLTg5NzYzNTY1MjI4NjMyMy1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MjItMTYyODU4LTB3OXdvbmI0GjUKL2pvYi03NjYyMDIwMDE5NTc3MzItcnVuLTg1MTMyMDkxNTkyMDA3Ny1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 2147483647,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0702-062133-81sr318g",
<       "cluster_name": "job-766221732976190-run-321685964984227",
<       "cluster_source": "JOB",
<       "creator_user_name": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d",
<       "custom_tags": {
<         "RemoveAfter": "2026070208"
<       },
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0702-062133-81sr318g",
<         "ClusterName": "job-766221732976190-run-321685964984227",
<         "Creator": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d",
<         "DatabricksInstanceGroupId": "-7571316921879686317",
<         "DatabricksInstancePoolCreatorId": "6779888502363704",
<         "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID",
<         "JobId": "766221732976190",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "uo6kA9ZP",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID",
<       "driver_instance_source": {
<         "instance_pool_id": "TEST_INSTANCE_POOL_ID"
<       },
<       "driver_node_type_id": "Standard_D8ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_pool_id": "TEST_INSTANCE_POOL_ID",
<       "instance_source": {
<         "instance_pool_id": "TEST_INSTANCE_POOL_ID"
<       },
<       "last_activity_time": 1782973327021,
<       "last_restarted_time": 1782973347913,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D8ads_v6",
<       "num_workers": 1,
<       "release_version": "16.4.26",
<       "spark_context_id": 3609173908294501583,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782973293941,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782973378069,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTEtMTUzMDEyLXBsYTJnYW8wGjUKL2pvYi03Njc2NzAwODQxMzM4ODAtcnVuLTM2MzY0ODU0NjU4NTU4My1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA3MDItMDYyMTMzLTgxc3IzMThnGi0KJ2pvYi03NjYyMjE3MzI5NzYxOTAtcnVuLTMyMTY4NTk2NDk4NDIyNxAGGAA="
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTEtMTUzMDEyLXBsYTJnYW8wGjUKL2pvYi03Njc2NzAwODQxMzM4ODAtcnVuLTM2MzY0ODU0NjU4NTU4My1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0617-115025-jwyyjk6o",
<       "cluster_name": "job-767715458126229-run-186289808442787-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026061713",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+2120260617115003"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0617-115025-jwyyjk6o",
<         "ClusterName": "job-767715458126229-run-186289808442787-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "767715458126229",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[URZL] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781697055503,
<       "last_restarted_time": 1781697086517,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 2347617329159366811,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781697025790,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781697174684,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MzAtMTY0NjAzLXFrdTJma2RzGjQKLmpvYi03Njk0MTcxMDA1NjY5My1ydW4tMTM3Nzk0NzU1Nzk4ODM3LWRlZmF1... (8 more bytes)",
<   "prev_page_token": "CAESFDA2MTctMTE1MDI1LWp3eXlqazZvGjUKL2pvYi03Njc3MTU0NTgxMjYyMjktcnVuLTE4NjI4OTgwODQ0Mjc4Ny1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MzAtMTY0NjAzLXFrdTJma2RzGjQKLmpvYi03Njk0MTcxMDA1NjY5My1ydW4tMTM3Nzk0NzU1Nzk4ODM3LWRlZmF1bHQQBhgA
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0629-223258-h92bh6v4",
<       "cluster_name": "job-769517568872705-run-1007147631681233-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026063000",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+1920260629223247"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0629-223258-h92bh6v4",
<         "ClusterName": "job-769517568872705-run-1007147631681233-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "769517568872705",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[EUMS] quality-checker",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1782772479447,
<       "last_restarted_time": 1782772440949,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 3067391386510099428,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782772378341,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782772512058,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTEtMDgzNzEwLWp0bWZxeWd3GjQKLmpvYi03NzEzMDM2Nzk4ODIwNy1ydW4tNzc5MzI5MDkxNTI5ODA5LWRlZmF1... (8 more bytes)",
<   "prev_page_token": "CAESFDA2MjktMjIzMjU4LWg5MmJoNnY0GjYKMGpvYi03Njk1MTc1Njg4NzI3MDUtcnVuLTEwMDcxNDc2MzE2ODEyMzMtZGVm... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTEtMDgzNzEwLWp0bWZxeWd3GjQKLmpvYi03NzEzMDM2Nzk4ODIwNy1ydW4tNzc5MzI5MDkxNTI5ODA5LWRlZmF1bHQQBhgA
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0609-174755-zurjfa4g",
<       "cluster_name": "job-771407185848979-run-843137146467946-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026060919",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+1720260609174740"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0609-174755-zurjfa4g",
<         "ClusterName": "job-771407185848979-run-843137146467946-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "771407185848979",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[IJNY] e2e",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781027311801,
<       "last_restarted_time": 1781027344096,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 4534430860597853234,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781027275967,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781027862620,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA3MDMtMDcxMTE4LTRsejFmenN3GjUKL2pvYi03NzI3Nzk0MDA0ODU5MDEtcnVuLTIzNTg1Nzc5NDAyNDU5NS1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MDktMTc0NzU1LXp1cmpmYTRnGjUKL2pvYi03NzE0MDcxODU4NDg5NzktcnVuLTg0MzEzNzE0NjQ2Nzk0Ni1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA3MDMtMDcxMTE4LTRsejFmenN3GjUKL2pvYi03NzI3Nzk0MDA0ODU5MDEtcnVuLTIzNTg1Nzc5NDAyNDU5NS1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0612-055949-vfg136dc",
<       "cluster_name": "job-772856817757997-run-688917858008671-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026061207",
<         "ResourceClass": "SingleNode",
<         "version": "v0.14.1+1720260612055718"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0612-055949-vfg136dc",
<         "ClusterName": "job-772856817757997-run-688917858008671-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "772856817757997",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[YGHF] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781244029776,
<       "last_restarted_time": 1781244059159,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 8998107689073272688,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781243989325,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781244153936,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA3MDYtMDYzMjA3LWQzamJjbmI0GiwKJmpvYi03NzQ5NDA0MzM4MTg3NC1ydW4tNzQ4MjE2MDk2MDEwMDY2EAYYAA==",
<   "prev_page_token": "CAESFDA2MTItMDU1OTQ5LXZmZzEzNmRjGjUKL2pvYi03NzI4NTY4MTc3NTc5OTctcnVuLTY4ODkxNzg1ODAwODY3MS1kZWZh... (12 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA3MDYtMDYzMjA3LWQzamJjbmI0GiwKJmpvYi03NzQ5NDA0MzM4MTg3NC1ydW4tNzQ4MjE2MDk2MDEwMDY2EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0629-100634-qe34sn40",
<       "cluster_name": "job-774989819302114-run-1077071676190435",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026062912",
<         "ResourceClass": "SingleNode"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0629-100634-qe34sn40",
<         "ClusterName": "job-774989819302114-run-1077071676190435",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "774989819302114",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "save_dataframe_as_table_notebook",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_E2ads_v6"
<       },
<       "driver_node_type_id": "Standard_E2ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_E2ads_v6"
<       },
<       "is_single_node": true,
<       "kind": "CLASSIC_PREVIEW",
<       "last_activity_time": 1782727980903,
<       "last_restarted_time": 1782727929914,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_E2ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.26",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 5244336686907233864,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1782727595100,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1782728051416,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MDktMTQ0ODM0LXduZmtrZ2psGjYKMGpvYi03NzY2MTk2MTI4NDE0MzUtcnVuLTEwNjAzOTE4MTg3OTA3MTktZGVm... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MjktMTAwNjM0LXFlMzRzbjQwGi4KKGpvYi03NzQ5ODk4MTkzMDIxMTQtcnVuLTEwNzcwNzE2NzYxOTA0MzUQBhgA"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MDktMTQ0ODM0LXduZmtrZ2psGjYKMGpvYi03NzY2MTk2MTI4NDE0MzUtcnVuLTEwNjAzOTE4MTg3OTA3MTktZGVmYXVsdBAGGAA=
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0614-045914-e8y88ydc",
<       "cluster_name": "job-776658525994432-run-16812101330813-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026061406",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+320260614045904"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0614-045914-e8y88ydc",
<         "ClusterName": "job-776658525994432-run-16812101330813-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "776658525994432",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[TBWN] profiler",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1781413187921,
<       "last_restarted_time": 1781413220837,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.25",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 628784010832861783,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1781413154775,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1781413288480,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTAtMTM1NDM0LWRuNGZleGhjGjUKL2pvYi03NzgxODkzNjMxMDE4NzktcnVuLTY0MTQwMzc5MDMzMzU5MC1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA2MTQtMDQ1OTE0LWU4eTg4eWRjGjQKLmpvYi03NzY2NTg1MjU5OTQ0MzItcnVuLTE2ODEyMTAxMzMwODEzLWRlZmF1... (8 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTAtMTM1NDM0LWRuNGZleGhjGjUKL2pvYi03NzgxODkzNjMxMDE4NzktcnVuLTY0MTQwMzc5MDMzMzU5MC1kZWZhdWx0EAYYAA==
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0609-052421-udmibg1s",
<       "cluster_name": "job-778270994109362-run-964875116366865-dqx_demo_cluster",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0609-052421-udmibg1s",
<         "ClusterName": "job-778270994109362-run-964875116366865-dqx_demo_cluster",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "778270994109362",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[3fe685a1-96cc-4fec-8cdb-6944f5c9787e] DQX Demo Job (jlox3i1k4d)",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_DS3_v2"
<       },
<       "driver_node_type_id": "Standard_DS3_v2",
<       "effective_spark_version": "15.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_DS3_v2"
<       },
<       "last_activity_time": 1780983083556,
<       "last_restarted_time": 1780983026015,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_DS3_v2",
<       "num_workers": 1,
<       "release_version": "15.4.40",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_context_id": 4734722485788479019,
<       "spark_version": "15.4.x-scala2.12",
<       "start_time": 1780982661258,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1780983270152,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MTMtMDYzMzExLXRtZGpsYnVvGi0KJ2pvYi03Nzk5NTQyNzUwNTE3NDItcnVuLTMzODE1MzAxODA4ODI5NRAGGAA=",
<   "prev_page_token": "CAESFDA2MDktMDUyNDIxLXVkbWliZzFzGj4KOGpvYi03NzgyNzA5OTQxMDkzNjItcnVuLTk2NDg3NTExNjM2Njg2NS1kcXhf... (24 more bytes)"
< }
07:08 DEBUG [databricks.sdk:assess_CLOUD_ENV_service_principals] GET /api/2.1/clusters/list?page_token=CAISFDA2MTMtMDYzMzExLXRtZGpsYnVvGi0KJ2pvYi03Nzk5NTQyNzUwNTE3NDItcnVuLTMzODE1MzAxODA4ODI5NRAGGAA=
< 200 OK
< {
<   "clusters": [
<     {
<       "assigned_principal": "user:3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "autotermination_minutes": 0,
<       "CLOUD_ENV_attributes": {
<         "availability": "ON_DEMAND_AZURE",
<         "first_on_demand": 1,
<         "spot_bid_max_price": -1.0
<       },
<       "cluster_id": "0702-223641-dexfin0g",
<       "cluster_name": "job-779961419596703-run-614561178204432-TEST_SCHEMA",
<       "cluster_source": "JOB",
<       "creator_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "custom_tags": {
<         "RemoveAfter": "2026070300",
<         "ResourceClass": "SingleNode",
<         "version": "v0.15.1+7320260702223631"
<       },
<       "data_security_mode": "SINGLE_USER",
<       "TEST_SCHEMA_tags": {
<         "Budget": "opex.sales.labs",
<         "ClusterId": "0702-223641-dexfin0g",
<         "ClusterName": "job-779961419596703-run-614561178204432-TEST_SCHEMA",
<         "Creator": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<         "JobId": "779961419596703",
<         "Owner": "labs-oss@databricks.com",
<         "RunName": "[2DWJ] anomaly-trainer",
<         "Vendor": "Databricks"
<       },
<       "disk_spec": {},
<       "driver_healthy": true,
<       "driver_instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "driver_node_type_id": "Standard_D4ads_v6",
<       "effective_spark_version": "16.4.x-scala2.12",
<       "enable_elastic_disk": true,
<       "enable_local_disk_encryption": false,
<       "init_scripts_safe_mode": false,
<       "instance_source": {
<         "node_type_id": "Standard_D4ads_v6"
<       },
<       "last_activity_time": 1783031843407,
<       "last_restarted_time": 1783031881178,
<       "last_state_loss_time": 0,
<       "node_type_id": "Standard_D4ads_v6",
<       "num_workers": 0,
<       "release_version": "16.4.27",
<       "single_user_name": "3fe685a1-96cc-4fec-8cdb-6944f5c9787e",
<       "spark_conf": {
<         "spark.databricks.cluster.profile": "singleNode",
<         "spark.master": "local[*]"
<       },
<       "spark_context_id": 1074458618933394873,
<       "spark_version": "16.4.x-scala2.12",
<       "start_time": 1783031802061,
<       "state": "TERMINATED",
<       "state_message": "",
<       "terminated_time": 1783031947322,
<       "termination_reason": {
<         "code": "JOB_FINISHED",
<         "type": "SUCCESS"
<       }
<     },
<     "... (19 additional elements)"
<   ],
<   "next_page_token": "CAISFDA2MjktMTMxMzA4LWMxNHdnOG93GjUKL2pvYi03ODIyNjA5MTU2NDQ5NzMtcnVuLTc3NzE4NDkyOTI2MTAwNi1kZWZh... (12 more bytes)",
<   "prev_page_token": "CAESFDA3MDItMjIzNjQxLWRleGZpbjBnGjUKL2pvYi03Nzk5NjE0MTk1OTY3MDMtcnVuLTYxNDU2MTE3ODIwNDQzMi1kZWZh... (12 more bytes)"
< }
07:08 INFO [databricks.labs.ucx.installer.workflows] ------ END REMOTE LOGS (SO FAR) -----
07:08 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+1220260707062844 from https://DATABRICKS_HOST
07:08 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s4y93slvo
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=870884847824019, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=589534137838593, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=803692167139670, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=212597576275588, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=428751359642194, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=748419625931679, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=79960091104875, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=70044596524438, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=555121809156153, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=355837841611248, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=164148070508887, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=251025086123327, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=93625335586851, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=811674287618286, as it is no longer needed
07:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=440110400837266, as it is no longer needed
07:08 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:08 INFO [databricks.labs.ucx.install] Deleting secret scope
07:08 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw7] linux -- Python 3.10.20 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #905}