Skip to main content

At Manta, OpenLineage Opens Doors to New Insights

· 2 min read
Ernie Ostic
SVP of Product at Manta

Adopting OpenLineage as part of our portfolio allows MANTA to bring detailed run-time lineage to our customers.

Here at MANTA, we are very excited to be working closely with OpenLineage and, more importantly, with the OpenLineage Community. As a leader in lineage analysis, we see first-hand the complexity required to achieve effective lineage, and the benefits of having an accepted standard for the sharing of operational lineage metadata. OpenLineage moves everything in the direction of enhanced interoperability, and helps to ensure that enterprises have maximum flexibility for current and future tool selection.

Adopting OpenLineage as part of our portfolio allows MANTA to bring detailed run-time lineage to our customers, many of whom are enterprise organizations and need this level of granularity. This is especially important for new technologies such as Apache Airflow, whose integration with OpenLineage continues to evolve. Apache Airflow, as an example, is increasingly being utilized by our customers as part of their process orchestration portfolio; as such, these companies need lineage coverage for these operations.

Having a recognized industry standard for lineage capture and reporting is an enabler for enhanced metadata management and governance. OpenLineage helps to ensure increased consistency in pipeline analysis, especially as more and more solutions appear in the Cloud, and in the general marketplace, for the transformation, enrichment, and overall movement of information through new and future dataflows. Vendors like MANTA will continue to offer creative and purposeful solutions that answer key questions and meet the end-to-end requirements of the business. For selected technologies, OpenLineage enables us to do this faster and simpler.

Eighteen months ago, we started our investigation into OpenLineage. After working with various customers earlier this year, we decided to double down on our investment and get more involved with the OpenLineage Community. Throughout our journey, we’ve found this growing community to be welcoming, helpful, and collaborative. MANTA is pleased to contribute however we can to this important open source project. Are you ready to join?

For more information about MANTA's data lineage solution, visit our website.

To learn more about contributing to OpenLineage, check out the project's new contributor guide.