kedro.extras.datasets¶
Description
kedro.extras.datasets
is where you can find all of Kedro’s data connectors.
These data connectors are implementations of the AbstractDataSet
.
Data Sets¶
kedro.extras.datasets.api.APIDataSet (url[, …]) |
APIDataSet loads the data from HTTP(S) APIs. |
kedro.extras.datasets.biosequence.BioSequenceDataSet (…) |
BioSequenceDataSet loads and saves data to a sequence file. |
kedro.extras.datasets.dask.ParquetDataSet (…) |
ParquetDataSet loads and saves data to parquet file(s). |
kedro.extras.datasets.geopandas.GeoJSONDataSet (…) |
GeoJSONDataSet loads/saves data to a GeoJSON file using an underlying filesystem (eg: local, S3, GCS). |
kedro.extras.datasets.matplotlib.MatplotlibWriter (…) |
MatplotlibWriter saves matplotlib objects to image file(s) in an underlying filesystem (e.g. |
kedro.extras.datasets.holoviews.HoloviewsWriter (…) |
HoloviewsWriter saves Holoviews objects to image file(s) in an underlying filesystem (e.g. |
kedro.extras.datasets.networkx.NetworkXDataSet (…) |
NetworkXDataSet loads and saves graphs to a JSON file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.CSVDataSet (filepath) |
CSVDataSet loads/saves data from/to a CSV file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.ExcelDataSet (…) |
ExcelDataSet loads/saves data from/to a Excel file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.AppendableExcelDataSet (…) |
AppendableExcelDataSet loads/saves data from/to a local Excel file opened in append mode. |
kedro.extras.datasets.pandas.FeatherDataSet (…) |
FeatherDataSet loads and saves data to a feather file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.GBQTableDataSet (…) |
GBQTableDataSet loads and saves data from/to Google BigQuery. |
kedro.extras.datasets.pandas.HDFDataSet (…) |
HDFDataSet loads/saves data from/to a hdf file using an underlying filesystem (e.g. |
kedro.extras.datasets.pandas.JSONDataSet (…) |
JSONDataSet loads/saves data from/to a JSON file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.ParquetDataSet (…) |
ParquetDataSet loads/saves data from/to a Parquet file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pandas.SQLQueryDataSet (…) |
SQLQueryDataSet loads data from a provided SQL query. |
kedro.extras.datasets.pandas.SQLTableDataSet (…) |
SQLTableDataSet loads data from a SQL table and saves a pandas dataframe to a table. |
kedro.extras.datasets.pickle.PickleDataSet (…) |
PickleDataSet loads/saves data from/to a Pickle file using an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.pillow.ImageDataSet (…) |
ImageDataSet loads/saves image data as numpy from an underlying filesystem (e.g.: local, S3, GCS). |
kedro.extras.datasets.spark.SparkDataSet (…) |
SparkDataSet loads and saves Spark dataframes. |
kedro.extras.datasets.spark.SparkHiveDataSet (…) |
SparkHiveDataSet loads and saves Spark dataframes stored on Hive. |
kedro.extras.datasets.spark.SparkJDBCDataSet (…) |
SparkJDBCDataSet loads data from a database table accessible via JDBC URL url and connection properties and saves the content of a PySpark DataFrame to an external database table via JDBC. |
kedro.extras.datasets.tensorflow.TensorFlowModelDataset (…) |
TensorflowModelDataset loads and saves TensorFlow models. |
kedro.extras.datasets.text.TextDataSet (filepath) |
TextDataSet loads/saves data from/to a text file using an underlying filesystem (e.g.: local, S3, GCS) |
kedro.extras.datasets.yaml.YAMLDataSet (filepath) |
YAMLDataSet loads/saves data from/to a YAML file using an underlying filesystem (e.g.: local, S3, GCS). |