1.1.0 - 2023-08-23
Added
- Flink: create Openlineage configuration based on Flink configuration
#2033@pawel-big-lebowski
Flink configuration entries starting withopenlineage.*are passed to the Openlineage client. - Java: add Javadocs to the Java client
#2004@julienledem
The client was missing some Javadocs. - Spark: append output dataset name to a job name
#2036@pawel-big-lebowski
Solves the problem of multiple jobs writing to different datasets while having the same job name. The feature is enabled by default and results in different job names. It can be disabled by settingspark.openlineage.jobName.appendDatasetNametofalse.
Unifies job names generated on the Databricks platform (using a dot job part separator instead of an underscore). The default behaviour can be altered withspark.openlineage.jobName.replaceDotWithUnderscore. - Spark: support Spark 3.4.1
#2057@pawel-big-lebowski
Bumps the latest Spark version to be covered in integration tests.