You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/snippets/cloud/integrations/databricks.mdx
+85Lines changed: 85 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -38,6 +38,91 @@ Then, select your authentication method:
38
38
long-lived personal access tokens.
39
39
</Info>
40
40
41
+
### Storage Access
42
+
43
+
Elementary requires access to the table history in order to enable automated monitors such as volume and freshness monitors.
44
+
You can configure this in one of the following ways:
45
+
46
+
#### Option 1: Fetch history using `DESCRIBE HISTORY`
47
+
48
+
Elementary can fetch the table history by running `DESCRIBE HISTORY` queries on your Databricks warehouse.
49
+
In the Elementary UI, choose **None** under **Storage access method**.
50
+
51
+
This requires `SELECT` access on the relevant tables, as described in the permissions and security section above.
52
+
53
+
#### Option 2: Credentials vending
54
+
55
+
Elementary can access the storage using temporary credentials issued by Databricks through [credential vending](https://docs.databricks.com/aws/en/external-access/credential-vending).
56
+
In the Elementary UI, choose **Credentials vending** under **Storage access method**.
57
+
58
+
This requires granting `EXTERNAL USE SCHEMA` on the relevant schemas.
59
+
60
+
When using this option, Elementary only reads the Delta transaction log files from storage.
61
+
62
+
#### Option 3: Direct storage access
63
+
64
+
Elementary can access the storage directly using credentials that you configure.
65
+
In the Elementary UI, choose **Direct storage access** under **Storage access method**.
66
+
67
+
When using this option, Elementary only reads the Delta transaction log files from storage.
68
+
69
+
For S3-backed Databricks storage, you can configure access in one of the following ways:
0 commit comments