Skip to content

Commit f721a57

Browse files
authored
Merge branch 'master' into 1944-add-orchestrator-job-data-alerts
2 parents 7f13126 + 272a40c commit f721a57

74 files changed

Lines changed: 2680 additions & 1263 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.github/workflows/stale.yml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,9 +11,10 @@ jobs:
1111
issues: write
1212
pull-requests: write
1313
steps:
14-
- uses: actions/stale@v5
14+
- uses: actions/stale@v10
1515
with:
16-
days-before-stale: 180
16+
days-before-stale: 60
17+
days-before-close: 30
1718
stale-issue-message: |
1819
This issue is stale because it has been open for too long with no activity.
1920
If you would like the issue to remain open, please remove the stale label or leave a comment.

.github/workflows/test-warehouse.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@ jobs:
121121
run: >
122122
pip install
123123
"dbt-core${{ inputs.dbt-version && format('=={0}', inputs.dbt-version) }}"
124-
"dbt-${{ (inputs.warehouse-type == 'databricks_catalog' && 'databricks') || inputs.warehouse-type }}${{ inputs.dbt-version && format('~={0}', inputs.dbt-version) }}"
124+
"dbt-${{ (inputs.warehouse-type == 'databricks_catalog' && 'databricks') || (inputs.warehouse-type == 'athena' && 'athena-community') || inputs.warehouse-type }}${{ inputs.dbt-version && format('~={0}', inputs.dbt-version) }}"
125125
126126
- name: Install Elementary
127127
run: |

README.md

Lines changed: 40 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1,80 +1,70 @@
11
<p align="center">
2-
<img alt="Logo" src="static/github_banner.png"/ width="1000">
2+
<img alt="Logo" src="https://res.cloudinary.com/do5hrgokq/image/upload/v1764493013/github_banner_zp5l2o.png" width="1000">
3+
</p>
4+
<p align="center">
5+
<a href="https://join.slack.com/t/elementary-community/shared_invite/zt-uehfrq2f-zXeVTtXrjYRbdE_V6xq4Rg"><img src="https://img.shields.io/badge/join-Slack-ff69b4"/></a>
6+
<a href="https://docs.elementary-data.com/oss/quickstart/quickstart-cli-package"><img src="https://img.shields.io/badge/docs-quickstart-orange"/></a>
7+
<img alt="License" src="https://img.shields.io/badge/license-Apache--2.0-ff69b4"/>
8+
<img alt="Downloads" src="https://static.pepy.tech/personalized-badge/elementary-lineage?period=total&units=international_system&left_color=grey&right_color=orange"&left_text=Downloads/>
39
</p>
410

511
<h2 align="center">
6-
dbt-native data observability for analytics & data engineers
12+
Elementary OSS: dbt-native data observability
713
</h2>
814

9-
<p align="center">
10-
<a href="https://www.elementary-data.com/community"><img src="https://img.shields.io/badge/join-Slack-ff69b4"/></a>
11-
<a href="https://docs.elementary-data.com/quickstart"><img src="https://img.shields.io/badge/docs-quickstart-orange"/></a>
12-
<img alt="License" src="https://img.shields.io/badge/license-Apache--2.0-ff69b4"/>
13-
<img alt="Downloads" src="https://static.pepy.tech/personalized-badge/elementary-lineage?period=total&units=international_system&left_color=grey&right_color=orange"&left_text=Downloads"/>
14-
1515
<div align="center">
1616

17-
⭐️ Star the repo <a href="https://github.com/elementary-data/elementary/stargazers"><img src="static/star_github.png" width="45"/></a> ⭐
18-
19-
[Demo »](https://bit.ly/3IAp9wf) | [Docs »](https://docs.elementary-data.com/) | [Slack »](https://www.elementary-data.com/community)
17+
[Docs »](https://docs.elementary-data.com/) | [Join the Elementary Community »](https://www.elementary-data.com/community)
2018

2119
</div>
20+
<div align="center">
21+
⭐️ Star the repo <a href="https://github.com/elementary-data/elementary/stargazers"><img src="static/star_github.png" width="45"/></a>
22+
</div>
23+
</br>
2224

23-
## What is Elementary?
24-
25-
Elementary is a dbt-native data observability solution for data and analytics engineers.
26-
Set up in minutes, gain immediate visibility, detect data issues, send actionable alerts, and understand impact and root cause.
27-
Elementary has two offerings: an open-source package and managed platform.
25+
**Built by the [Elementary](https://www.elementary-data.com) team, helping you deliver trusted data in the AI era.**
2826

29-
<kbd align="center">
30-
<a href="https://storage.googleapis.com/elementary_static/elementary_demo.html"><img align="center" style="max-width:300px;" src="static/report_ui.gif"> </a>
31-
</kbd>
27+
Elementary OSS is the open-source CLI for dbt-native data observability. It works with the [Elementary dbt package](https://github.com/elementary-data/dbt-data-reliability) to generate the basic Elementary observability report and send alerts to Slack and Microsoft Teams.
3228

33-
<br>
29+
For teams that need data reliability at scale, we offer **[Elementary Cloud](https://www.elementary-data.com/)**, a full Data & AI Control Plane with automated ML monitoring, column-level lineage from source to BI, a built-in catalog, and AI agents that scale reliability workflows for both engineers and business users.
3430

35-
## Open-source Package vs. Cloud Platform
31+
![Demo](static/newreadmedemo.gif)
3632

37-
### Elementary Cloud Platform
33+
## How It Works
3834

39-
Ideal for teams monitoring mission-critical data pipelines, requiring guaranteed uptime and reliability, short-time-to-value, advanced features, collaboration, and professional support.
40-
The solution is secure by design, and requires no access to your data from cloud.
35+
Elementary OSS connects to your warehouse and reads the metadata, artifacts, and test results collected by the Elementary dbt package.
36+
With this information, it can:
4137

42-
[Get started with Elementary Cloud](https://docs.elementary-data.com/quickstart)
38+
- Generate a data observability report
39+
- Surface anomalies and failed tests
40+
- Send alerts to Slack and Teams
41+
- Track model and test performance trends
4342

44-
### Open-source Package
43+
## Quickstart
4544

46-
Elementary Community is an open-source CLI tool you can deploy and orchestrate to send Slack alerts and self-host the Elementary report. It is best for data and analytics engineers that require basic observability capabilities.
45+
Follow the quickstart guide to install and configure the Elementary dbt package and CLI:
4746

48-
[Get started with the Open-source Package](https://docs.elementary-data.com/oss/oss-introduction)
47+
👉 https://docs.elementary-data.com/oss/quickstart
4948

5049
## Features
5150

52-
**Anomaly detection tests** - Collect data quality metrics and detect anomalies, as native dbt tests.
53-
54-
**Automated monitors** - Out-of-the-box cloud monitors to detect freshness, volume and schema issues.
55-
56-
**End-to-End Data Lineage** - Enriched with the latest test results, for impact and root cause analysis of data issues. Elementary Cloud offers **Column Level Lineage** and **BI integrations**.
57-
58-
**Data quality dashboard** - Single interface for all your data monitoring and test results.
59-
60-
**Models performance** - Monitor models and jobs run results and performance over time.
61-
62-
**Configuration-as-code** - Elementary configuration is managed in your dbt code.
63-
64-
**Alerts** - Actionable alerts including custom channels and tagging of owners.
65-
66-
**Data catalog** - Explore your datasets information - descriptions, columns, datasets health, etc.
67-
68-
**dbt artifacts uploader** - Save metadata and run results as part of your dbt runs.
69-
70-
**AI-Powered Data Tests & Unstructured Data Validations** - Validate and monitor data using AI powered tests to validate both structured and unstructured data
51+
- **Anomaly detection tests** - Collect data quality metrics and detect anomalies, as native dbt tests.
52+
- **Automated monitors** - Out-of-the-box cloud monitors to detect freshness, volume and schema issues.
53+
- **End-to-End Data Lineage** - Enriched with the latest test results, for impact and root cause analysis of data issues. Elementary Cloud offers **Column-Level-Lineage from ingestion to BI**.
54+
- **Data quality dashboard** - Single interface for all your data monitoring and test results.
55+
- **Models performance** - Monitor models and jobs run results and performance over time.
56+
- **Configuration-as-code** - Elementary configuration is managed in your dbt code.
57+
- **Alerts** - Actionable alerts including custom channels and tagging of owners.
58+
- **Data catalog** - Explore your datasets information - descriptions, columns, datasets health, etc.
59+
- **dbt artifacts uploader** - Save metadata and run results as part of your dbt runs.
60+
- **AI-Powered Data Tests & Unstructured Data Validations** - Validate and monitor data using AI powered tests to validate both structured and unstructured data
7161

7262
## Support
7363

74-
For additional information and help, you can use one of these channels:
64+
For additional information and help:
7565

76-
- [Slack community](https://www.elementary-data.com/community) \(Release announcements, community support, discussions, etc.\)
77-
- [GitHub issues](https://github.com/elementary-data/elementary/issues) \(Bug reports, feature requests)
66+
- [Join thousands of users in the Slack community](https://www.elementary-data.com/community) \(Release announcements, community and AI support, discussions, etc.\)
67+
- [Open a GitHub issue](https://github.com/elementary-data/elementary/issues) \(Bug reports, feature requests)
7868
- Check out the [contributions guide](./CONTRIBUTING.md) and [open issues](https://github.com/elementary-data/elementary/issues).
7969

8070
##

docs/_snippets/quickstart-package-install.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ Some packages we recommend you check out: [dbt_utils](https://github.com/dbt-lab
3939
```yml packages.yml
4040
packages:
4141
- package: elementary-data/elementary
42-
version: 0.20.0
42+
version: 0.21.0
4343
## Docs: https://docs.elementary-data.com
4444
```
4545
</Step>

0 commit comments

Comments
 (0)