Setup

Preparation

The integration expects openlineage-java, spark-extension-interfaces and openlineage-sql-java to exist in your local maven repository, so before building/testing the Spark integration you need to first build and publish the required dependencies.

You can do it using Task:

task setup

Testing

To run the tests, from the current directory run:

task test

To run the integration tests (requires Docker), from the current directory run:

task integration-test

Build jar

task jar