Expecting Great Quality with OpenLineage Facets
Good data is paramount to making good decisions- but how can you trust the quality of your data and its dependencies?
Good data is paramount to making good decisions- but how can you trust the quality of your data and its dependencies?
Facets are a self-contained definition of one aspect of a job, dataset, or run at the time the event happened. They make the OpenLineage model extensible.
Becoming a LF AI & Data project ensures that OpenLineage can never belong to a company, or even a group of developers; it belongs to us all.
Taking advantage of recent changes to the Marquez API, this post shows how to diagnose job failures and explore the impact of code changes on downstream dependents.
In this blog post, we'll discuss how lineage metadata can be used to automatically backfill DAGs with complex upstream and downstream dependencies.
The data world and the service world have many similarities but also a few crucial differences.