Releases: kedro-org/kedro-plugins
Releases · kedro-org/kedro-plugins
kedro-airflow-0.9.1
- Added support to specify
--conf-source
which would point to the runtime configuration directory to be used for running the DAG in airflow. This configuration path is added to the generated DAG.
kedro-datasets-4.0.0
Major features and improvements
- Added the following new experimental datasets:
Type | Description | Location |
---|---|---|
langchain.ChatAnthropicDataset |
A dataset for loading a ChatAnthropic langchain model. | kedro_datasets_experimental.langchain |
langchain.ChatCohereDataset |
A dataset for loading a ChatCohere langchain model. | kedro_datasets_experimental.langchain |
langchain.OpenAIEmbeddingsDataset |
A dataset for loading a OpenAIEmbeddings langchain model. | kedro_datasets_experimental.langchain |
langchain.ChatOpenAIDataset |
A dataset for loading a ChatOpenAI langchain model. | kedro_datasets_experimental.langchain |
rioxarray.GeoTIFFDataset |
A dataset for loading and saving geotiff raster data | kedro_datasets_experimental.rioxarray |
netcdf.NetCDFDataset |
A dataset for loading and saving "*.nc" files. | kedro_datasets_experimental.netcdf |
- Added the following new core datasets:
Type | Description | Location |
---|---|---|
dask.CSVDataset |
A dataset for loading a CSV files using dask |
kedro_datasets.dask |
- Extended preview feature to
yaml.YAMLDataset
.
Bug fixes and other changes
- Added
metadata
parameter for a few datasets
Breaking Changes
netcdf.NetCDFDataset
moved fromkedro_datasets
tokedro_datasets_experimental
.
Community contributions
Many thanks to the following Kedroids for contributing PRs to this release:
kedro-telemetry-0.5.0
- Updated the plugin to generate a unique project UUID for kedro project and store it in
pyproject.toml
.
kedro-datasets-3.0.1
Bug fixes and other changes
- Removed arbitrary upper bound for
s3fs
. NetCDFDataset
support for NetCDF4 viaengine="netcdf4"
andengine="h5netcdf"
Community contributions
Many thanks to the following Kedroids for contributing PRs to this release:
kedro-airflow-0.9.0
- Sort DAGs to make sure
kedro airflow create
is deterministic. - Option to group MemoryDatasets in the same Airflow task (breaking change for custom template via
--jinja-file
). - Include the environment name in the DAG file name when different from the default.
- Added support for Python 3.12
kedro-telemetry-0.4.0
- Updated the plugin to generate an unique UUID for each user of
kedro-telemetry
. - Added support for Python 3.12.
kedro-docker-0.6.0
Major features and improvements
- Added support for Python 3.12
kedro-datasets-3.0.0
Major features and improvements
- Added the following new datasets:
Type | Description | Location |
---|---|---|
netcdf.NetCDFDataset |
A dataset for loading and saving *.nc files. |
kedro_datasets.netcdf |
ibis.TableDataset |
A dataset for loading and saving using Ibis's backends. | kedro_datasets.ibis |
- Added support for Python 3.12.
- Normalised optional dependencies names for datasets to follow PEP 685. The
.
characters have been replaced with-
in the optional dependencies names. Note that this might be breaking for some users. For example, users should now install optional dependencies forpandas.ParquetDataset
fromkedro-datasets
like this:
pip install kedro-datasets[pandas-parquetdataset]
- Removed
setup.py
and move topyproject.toml
completely forkedro-datasets
.
Bug fixes and other changes
- If using MSSQL,
load_args:params
will be typecasted as tuple. - Fixed bug with loading datasets from Hugging Face. Now allows passing parameters to the load_dataset function.
- Made
connection_args
argument optional when callingcreate_connection()
insql_dataset.py
.
Community contributions
Many thanks to the following Kedroids for contributing PRs to this release:
kedro-telemetry-0.3.2
- Updated plugin to share if a project is being run in a ci environment.
- Updated plugin to share if
example_pipeline
option is selected during project creation. - Fixed the masking of the commands when commands contain words from the Kedro vocabulary.
kedro-datasets-2.1.0
Major features and improvements
- Added
MatlabDataset
which usesscipy
to save and load.mat
files. - Extend preview feature for matplotlib, plotly and tracking datasets.
- Allow additional parameters for sqlalchemy engine when using sql datasets.
Bug fixes and other changes
- Removed Windows specific conditions in
pandas.HDFDataset
extra dependencies
Community contributions
Many thanks to the following Kedroids for contributing PRs to this release: