0.10.0 - 2022-06-24
Added
- Add static code anlalysis tool mypy to run in CI for against all python modules (
#802) @howardyoo - Extend
SaveIntoDataSourceCommandVisitorto extract schema fromLocalRelaitonandLogicalRddin spark integration (#794) @pawel-big-lebowski - Add
InMemoryRelationInputDatasetBuilderforInMemorydatasets to Spark integration (#818) @pawel-big-lebowski - Add copyright to source files
#755@merobi-hub - Add
SnowflakeOperatorAsyncextractor support to Airflow integration#869@merobi-hub - Add PMD analysis to proxy project (
#889) @howardyoo
Changed
- Skip
FunctionRegistry.classserialization in Spark integration (#828) @mobuchowski - Install new
rust-based SQL parser by default in Airflow integration (#835) @mobuchowski - Improve overall
pytestand integration tests for Airflow integration (#851,#858) @denimalpaca - Reduce OL event payload size by excluding local data and including output node in start events (
#881) @collado-mike - Split spark integration into submodules (
#834,#890) @tnazarew @mobuchowski
Fixed
- Conditionally import
sqlalchemylib for Great Expectations integration (#826) @pawel-big-lebowski - Add check for missing class
org.apache.spark.sql.catalyst.plans.logical.CreateV2Tablein Spark integration (#866) @pawel-big-lebowski - Fix static code analysis issues (
#867,#874) @pawel-big-lebowski