0.22.0 - 2023-04-03
Added
- Spark: properties facet
#1717@tnazarew
Adds a new facet to capture specified Spark properties. - SQL: SQLParser supports
alter,truncateanddropstatements#1695@pawel-big-lebowski
Adds support for the statements to the parser. - Common/SQL: provide public interface for openlineage_sql package
#1727@JDarDagran
Provides a.pyipublic interface file for providing typing hints. - Java client: add configurable headers to HTTP transport
#1718@tnazarew
Adds custom header handling toHttpTransportand the Spark integration. - Python client: create client from dictionary
#1745@JDarDagran
Adds a newfrom_dictmethod to the Python client to support creating it from a dictionary.
Changed
- Spark: remove URL parameters for JDBC namespaces
#1708@tnazarew
Makes the namespace value from an event conform to the naming convention specified in Naming.md. - Make
OPENLINEAGE_DISABLEDcase-insensitive#1705@jedcunningham
Makes the environment variable for disabling OpenLineage in the Python client and Airflow integration case-insensitive.
Fixed
- Spark: fix missing BigQuery class in column lineage
#1698@pawel-big-lebowski
The Spark integration now checks if the BigQuery classes are available on the classpath before attempting to use them. - DBT: throw
UnsupportedDbtCommandwhen finding unsupported entry inargs.which#1724@JDarDagran
Adjusts thedbt-olscript to detect DBT commands inrun_results.jsononly.
Removed
- Spark: remove unnecessary warnings for column lineage
#1700@pawel-big-lebowski
Removes the warnings aboutOneRowRelationandLocalRelationnodes. - Spark: remove deprecated configs
#1711@tnazarew
Removes support for deprecated configs.