1.4.1 - 2023-10-09
Added
- Client: allow setting client's endpoint via environment variable
#2151
@mars-lan
Enables setting this endpoint via environment variable because creating the client manually in Airflow is not possible. - Flink: expand Iceberg source types
#2149
@HuangZhenQiu
Adds support forFlinkIcebergSource
andFlinkIcebergTableSource
for Flink Iceberg lineage. - Spark: add debug facet
#2147
@pawel-big-lebowski
An extra run facet containing some system details (e.g., OS, Java, Scala version), classpath (e.g., package versions, jars included in the Spark job), SparkConf (like openlineage entries except auth, specified extensions, etc.) and LogicalPlan details (execution tree nodes' names) are added to events emitted. SparkConf settingspark.openlineage.debugFacet=enabled
needs to be set to include the facet. By default, the debug facet is disabled. - Spark: enable Nessie REST catalog
#2165
@julwin
Adds support for Nessie catalog in Spark.