1.41.0 - 2025-12-11
Added
- Spec: Add arbitrary extra info to JobDependency in JobDependenciesRunFacet
#4189@kacpermuda Add support for arbitrary extra information in JobDependency within JobDependenciesRunFacet. - Python: Add debug mode to file transport
#4185@kacpermuda Add debug mode support to file transport for better troubleshooting. - dbt: Add dbt model meta.owner to OpenLineage events
#4160@harels Add support for capturing dbt model owner information from meta.owner in OpenLineage events. - dbt: Add DbtNodeJobFacet
#4151@mobuchowski Add DbtNodeJobFacet to provide additional dbt node information in job facets. - Spark: Add default name to hive catalog facet
#4161@tnazarew Add default name support to Hive catalog facet in Spark integration. - Spark: Fetch input statistics for single input RDD
#4134@pawel-big-lebowski Add support for fetching input statistics for single input RDD jobs.
Changed
- SQL: Migrate from sqlparser fork to upstream 0.59
#4153@kchledowski Migrate SQL parser from fork to upstream version 0.59 for better maintenance and compatibility. - Spark: Less aggressive normalization in UUID case
#4178@mobuchowski Reduce aggressiveness of UUID normalization in Spark integration.
Fixed
- Python: Small log change
#4186@kacpermuda Improve logging output in Python client. - Spark: Ensure relation size in bytes is sane
#4165@dolfinus Fix relation size calculation to ensure values are within reasonable bounds. - Spec: Add missing job facet schema
#4154@mobuchowski Add missing job facet schema to specification.