Backfilling Airflow DAGs using Marquez
· 8 min read
In this blog post, we'll discuss how lineage metadata can be used to automatically backfill DAGs with complex upstream and downstream dependencies.
In this blog post, we'll discuss how lineage metadata can be used to automatically backfill DAGs with complex upstream and downstream dependencies.
The data world and the service world have many similarities but also a few crucial differences.