You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
refactor: rename asset to entity across scripts, docs, and comments
Replace all user-facing and internal references to "asset" with
"entity" to align with the new Entity+Edge data model. This includes
Tengo script variables (asset → entity, new_asset → new_entity),
processor/sink code, test fixtures, READMEs, and documentation.
Copy file name to clipboardExpand all lines: docs/concepts/context_graph.mdx
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,9 +12,9 @@ Meteor closes this gap. By continuously extracting metadata — schemas, lineage
12
12
13
13
## What is a Context Graph?
14
14
15
-
A context graph is a connected, queryable representation of your data ecosystem. It captures not just what assets exist, but how they relate to each other:
15
+
A context graph is a connected, queryable representation of your data ecosystem. It captures not just what entities exist, but how they relate to each other:
-**Edges** represent relationships: lineage (which table feeds which dashboard), ownership (who is responsible), membership (who belongs to which team), and dependency (which job produces which dataset).
19
19
20
20
Unlike a flat catalog or a search index, a context graph preserves **structure**. It knows that a revenue dashboard depends on a sales table, which is produced by an ETL job, which reads from a Kafka topic. This structure is what makes AI useful over enterprise data.
@@ -34,10 +34,10 @@ Meteor's extractors connect to 30+ data sources — databases (BigQuery, Postgre
34
34
35
35
### Process
36
36
37
-
Processors enrich and transform assets in-flight before they reach a sink. Use them to:
37
+
Processors enrich and transform entities in-flight before they reach a sink. Use them to:
38
38
39
39
- Append **labels** for classification (environment, domain, sensitivity, PII)
40
-
-**Enrich**assets with custom fields from external systems
40
+
-**Enrich**entities with custom fields from external systems
41
41
- Run **scripts** (Tengo) for arbitrary transformation logic, including HTTP calls to external APIs
42
42
43
43
### Deliver
@@ -77,7 +77,7 @@ With Meteor's lineage graph, AI can:
77
77
-**Root-cause analysis** — "This metric dropped. What changed upstream?"
78
78
-**Dependency awareness** — "Before deprecating this dataset, show me everything downstream."
79
79
80
-
### Asset Discovery for AI Agents
80
+
### Entity Discovery for AI Agents
81
81
82
82
Function-calling AI agents need to know what tools and data are available. The context graph serves as the agent's **world model**:
83
83
@@ -96,10 +96,10 @@ Meteor's plugin architecture makes it straightforward to extend the context grap
96
96
97
97
| Capability | Approach |
98
98
|---|---|
99
-
|**Semantic search**| Use a script processor to generate vector embeddings from asset descriptions, enabling similarity-based retrieval |
100
-
|**Business glossary**| Extract metric definitions and business terms as first-class assets, linking them to underlying tables |
101
-
|**Usage signals**| Build extractors that capture query frequency and dashboard views, helping AI rank assets by relevance |
102
-
|**Data quality**| Enrich assets with freshness, completeness, and anomaly scores so AI can assess data trustworthiness |
99
+
|**Semantic search**| Use a script processor to generate vector embeddings from entity descriptions, enabling similarity-based retrieval |
100
+
|**Business glossary**| Extract metric definitions and business terms as first-class entities, linking them to underlying tables |
101
+
|**Usage signals**| Build extractors that capture query frequency and dashboard views, helping AI rank entities by relevance |
102
+
|**Data quality**| Enrich entities with freshness, completeness, and anomaly scores so AI can assess data trustworthiness |
103
103
|**LLM-optimized exports**| Create sinks that format metadata as structured context windows sized for LLM consumption |
104
104
105
105
## The Flywheel
@@ -109,7 +109,7 @@ The context graph is not a one-time build. It is a continuously improving loop:
109
109
1.**Meteor extracts** metadata from across the data ecosystem
110
110
2.**The context graph** grows richer with each extraction cycle
111
111
3.**AI systems** use the graph for grounding, reasoning, and discovery
In this example, each entity first gets enriched with a `domain` attribute, then gets labeled with `source: meteor`, and finally has its name modified by the script processor.
Extracts BigQuery metadata with column profiling enabled and streams it to a Kafka topic. The `key_path` config keys each message by asset URN for consistent partitioning.
27
+
Extracts BigQuery metadata with column profiling enabled and streams it to a Kafka topic. The `key_path` config keys each message by entity URN for consistent partitioning.
Demonstrates multiple sinks and chained processors. Extracts BigQuery metadata with column profiling and view lineage, enriches and labels assets, then sends to both Compass and Kafka simultaneously.
49
+
Demonstrates multiple sinks and chained processors. Extracts BigQuery metadata with column profiling and view lineage, enriches and labels entities, then sends to both Compass and Kafka simultaneously.
Copy file name to clipboardExpand all lines: docs/reference/processors.mdx
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -70,15 +70,15 @@ processors:
70
70
71
71
## script
72
72
73
-
Transforms the entity using a user-defined script. The entity is exposed to the script as an `asset` variable (a map). Currently [Tengo][tengo] is the only supported engine. The script has full control over entity fields, including the ability to make HTTP calls to external services.
73
+
Transforms the entity using a user-defined script. The entity is exposed to the script as an `entity` variable (a map). Currently [Tengo][tengo] is the only supported engine. The script has full control over entity fields, including the ability to make HTTP calls to external services.
0 commit comments