0.9.0 - 2022-06-03
Added
- Add static code anlalysis tool mypy to run in CI for against all python modules (#802) @howardyoo
- Extend SaveIntoDataSourceCommandVisitorto extract schema fromLocalRelaitonandLogicalRddin spark integration (#794) @pawel-big-lebowski
- Add InMemoryRelationInputDatasetBuilderforInMemorydatasets to Spark integration (#818) @pawel-big-lebowski
- Add copyright to source files #755@merobi-hub
- Add SnowflakeOperatorAsyncextractor support to Airflow integration#869@merobi-hub
- Add PMD analysis to proxy project (#889) @howardyoo
Changed
- Skip FunctionRegistry.classserialization in Spark integration (#828) @mobuchowski
- Install new rust-based SQL parser by default in Airflow integration (#835) @mobuchowski
- Improve overall pytestand integration tests for Airflow integration (#851,#858) @denimalpaca
- Reduce OL event payload size by excluding local data and including output node in start events (#881) @collado-mike
- Split spark integration into submodules (#834,#890) @tnazarew @mobuchowski
Fixed
- Conditionally import sqlalchemylib for Great Expectations integration (#826) @pawel-big-lebowski
- Add check for missing class org.apache.spark.sql.catalyst.plans.logical.CreateV2Tablein Spark integration (#866) @pawel-big-lebowski
- Fix static code analysis issues (#867,#874) @pawel-big-lebowski