0.25.0 - 2023-05-15
Added
- Spark: add Spark/Delta
merge into
support#1823
@pawel-big-lebowski
Adds support formerge into
queries.
Fixed
- Spark: fix JDBC query handling
#1808
@nataliezeller1
Makes query handling more tolerant of variations in syntax and formatting. - Spark: filter Delta adaptive plan events
#1830
@pawel-big-lebowski
Extends theDeltaEventFilter
class to filter events in cases where rewritten queries in adaptive Spark plans generate extra events. - Spark: fix Java class cast exception
#1844
@Anirudh181001
Fixes the error caused by theOpenLineageRunEventBuilder
when it cast the Spark scheduler'sShuffleMapStage
to boolean. - Flink: include missing fields of Openlineage events
#1840
@pawel-big-lebowski Enriches Flink events so that missingeventTime
,runId
andjob
elements no longer produce errors.