At this year's Kafka Summit in London, two project committers, Paweł Leszczyński and Maciej Obuchowski, will give a talk entitled OpenLineage for Stream Processing on March 19th at 2:00 PM GMT.
As the abstract available on the summit website says, the talk will cover some of the 'many useful features completed or begun' recently related to stream processing, including:
- a seamless OpenLineage & Apache Flink integration,
- support for streaming jobs in Marquez,
- progress on a built-in lineage API within the Flink codebase.
As the abstract goes on to say,
Cross-platform lineage allows for a holistic overview of data flow and its dependencies within organizations, including stream processing. This talk will provide an overview of the most recent developments in the OpenLineage Flink integration and share what’s in store for this important collaboration. This talk is a must-attend for those wishing to stay up-to-date on lineage developments in the stream processing world.
Register and attend this interesting talk if you can. And keep an eye out for an announcement about a recording if and when one becomes available.
Thanks, Maciej and Paweł, for spreading the word about these exciting developments in the project.