0.9.0 - 2022-06-03
Added
- Add static code anlalysis tool mypy to run in CI for against all python modules (
#802
) @howardyoo - Extend
SaveIntoDataSourceCommandVisitor
to extract schema fromLocalRelaiton
andLogicalRdd
in spark integration (#794
) @pawel-big-lebowski - Add
InMemoryRelationInputDatasetBuilder
forInMemory
datasets to Spark integration (#818
) @pawel-big-lebowski - Add copyright to source files
#755
@merobi-hub - Add
SnowflakeOperatorAsync
extractor support to Airflow integration#869
@merobi-hub - Add PMD analysis to proxy project (
#889
) @howardyoo
Changed
- Skip
FunctionRegistry.class
serialization in Spark integration (#828
) @mobuchowski - Install new
rust
-based SQL parser by default in Airflow integration (#835
) @mobuchowski - Improve overall
pytest
and integration tests for Airflow integration (#851
,#858
) @denimalpaca - Reduce OL event payload size by excluding local data and including output node in start events (
#881
) @collado-mike - Split spark integration into submodules (
#834
,#890
) @tnazarew @mobuchowski
Fixed
- Conditionally import
sqlalchemy
lib for Great Expectations integration (#826
) @pawel-big-lebowski - Add check for missing class
org.apache.spark.sql.catalyst.plans.logical.CreateV2Table
in Spark integration (#866
) @pawel-big-lebowski - Fix static code analysis issues (
#867
,#874
) @pawel-big-lebowski