You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
>**Note:** The Snowflake credentials (`SNOWFLAKE_ACCOUNT`, `SNOWFLAKE_USER`, `SNOWFLAKE_PASSWORD`) are required for the ingestion job to connect to Snowflake. The Databricks credentials are used by the Job Executor App for API authentication.
137
+
136
138
#### Cluster Environment Variables
137
139
138
140
Set in**Cluster → Advanced Options → Spark → Environment Variables**:
|`DATABRICKS_CLIENT_ID`|Service principal OAuth M2M client ID |
170
+
|`DATABRICKS_CLIENT_SECRET`|Service principal OAuth M2M client secret |
171
+
|`DATABRICKS_CLUSTER_ID`|Existing all-purpose cluster ID forrunning job tasks|
172
+
|`UC_CATALOG`| Unity Catalog name for schema and volume creation |
173
+
|`DEVS_GROUP`|Databricks group name for job and catalog permissions |
157
174
158
175
>**Note:** The `DEVS_GROUP` (e.g., `migration-accelerator-devs`) must exist in Databricks before deployment. Create it in**Admin Console → Groups → Create Group**.
159
176
177
+
>**Secrets vs GitHub Secrets:** Databricks Secrets (in the scope) are read at **runtime** by the jobs. GitHub Secrets are used at **deploy time** by the CI/CD pipeline to authenticate and configure the bundle.
178
+
160
179
#### After deployment
161
180
162
181
Once deployed, get the service principal name from the Databricks App in Compute->Apps->dbx-job-executor-app->Authorization->App Authorization and th job id from Jobs & Pipelines->snowflake_ingestion_job->Job Details->Job ID.
0 commit comments