You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use the namespace selector at the top to switch between the namespaces that produced the lineage:
163
+
The landing page lists the OpenLineage *Jobs* that Trino and Airflow reported, together with the event,
164
+
dataset and source counts. You should see the `openlineage_demo` DAG job and the per-query jobs such as
165
+
`openlineage_demo.customer_orders.query.*`, all *COMPLETED*:
166
+
167
+
image::openlineage/marquez.png[Marquez home page listing the collected OpenLineage jobs as COMPLETED]
168
+
169
+
Selecting a job opens its details. For example, `openlineage_demo.load_orders.query.2` shows the exact
170
+
`CREATE TABLE memory.demo.orders AS SELECT ...` statement along with its OpenLineage *job* and *run*
171
+
facets rendered as JSON - including the `sql` facet, the `AIRFLOW` integration, and the `externalQuery`
172
+
facet that links back to the originating Trino query ID:
173
+
174
+
image::openlineage/job-details-customer-orders-2.png[Marquez job details for load_orders showing the SQL statement and OpenLineage facets as JSON]
175
+
176
+
== Explore the lineage in Marquez
177
+
178
+
With the Marquez UI still open at http://localhost:3000, use the namespace selector at the top to switch
179
+
between the namespaces that produced the lineage:
134
180
135
181
* the Trino namespace (named after `openlineage-event-listener.trino.uri`, i.e. `http://trino-coordinator:8080`),
136
182
which contains the `tpch.tiny.*` and `memory.demo.*` datasets and the queries connecting them, and
137
183
* `airflow-openlineage-demo`, which contains the `openlineage_demo` DAG and its tasks.
138
184
139
185
Selecting the `memory.demo.customer_orders` dataset and expanding upstream shows the full graph back to
140
-
`tpch.tiny.customer` and `tpch.tiny.orders`, including column-level lineage for the individual queries.
186
+
`tpch.tiny.customer` and `tpch.tiny.orders`, including column-level lineage for the individual queries:
187
+
188
+
image::openlineage/customer-orders-2.png[Marquez lineage graph tracing memory.demo.customer_orders upstream through the jobs to tpch.tiny.customer and tpch.tiny.orders]
0 commit comments