kedro.extras.datasets

Description

kedro.extras.datasets is where you can find all of Kedro’s data connectors. These data connectors are implementations of the AbstractDataSet.

Classes

kedro.extras.datasets.api.APIDataSet(url[, …])

APIDataSet loads the data from HTTP(S) APIs.

kedro.extras.datasets.biosequence.BioSequenceDataSet(…)

BioSequenceDataSet loads and saves data to a sequence file.

kedro.extras.datasets.dask.ParquetDataSet(…)

ParquetDataSet loads and saves data to parquet file(s).

kedro.extras.datasets.email.EmailMessageDataSet(…)

EmailMessageDataSet loads/saves an email message from/to a file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.geopandas.GeoJSONDataSet(…)

GeoJSONDataSet loads/saves data to a GeoJSON file using an underlying filesystem (eg: local, S3, GCS).

kedro.extras.datasets.holoviews.HoloviewsWriter(…)

HoloviewsWriter saves Holoviews objects to image file(s) in an underlying filesystem (e.g.

kedro.extras.datasets.json.JSONDataSet(filepath)

JSONDataSet loads/saves data from/to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.matplotlib.MatplotlibWriter(…)

MatplotlibWriter saves one or more Matplotlib objects as image files to an underlying filesystem (e.g.

kedro.extras.datasets.networkx.GMLDataSet(…)

GMLDataSet loads and saves graphs to a GML file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.networkx.GraphMLDataSet(…)

GraphMLDataSet loads and saves graphs to a GraphML file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.networkx.JSONDataSet(…)

NetworkX JSONDataSet loads and saves graphs to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.CSVDataSet(filepath)

CSVDataSet loads/saves data from/to a CSV file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.ExcelDataSet(…)

ExcelDataSet loads/saves data from/to a Excel file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.FeatherDataSet(…)

FeatherDataSet loads and saves data to a feather file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.GBQQueryDataSet([…])

GBQQueryDataSet loads data from a provided SQL query from Google BigQuery.

kedro.extras.datasets.pandas.GBQTableDataSet(…)

GBQTableDataSet loads and saves data from/to Google BigQuery.

kedro.extras.datasets.pandas.GenericDataSet(…)

pandas.GenericDataSet loads/saves data from/to a data file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.HDFDataSet(…)

HDFDataSet loads/saves data from/to a hdf file using an underlying filesystem (e.g.

kedro.extras.datasets.pandas.JSONDataSet(…)

JSONDataSet loads/saves data from/to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.ParquetDataSet(…)

ParquetDataSet loads/saves data from/to a Parquet file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pandas.SQLQueryDataSet([…])

SQLQueryDataSet loads data from a provided SQL query.

kedro.extras.datasets.pandas.SQLTableDataSet(…)

SQLTableDataSet loads data from a SQL table and saves a pandas dataframe to a table.

kedro.extras.datasets.pandas.XMLDataSet(filepath)

XMLDataSet loads/saves data from/to a XML file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pickle.PickleDataSet(…)

PickleDataSet loads/saves data from/to a Pickle file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.pillow.ImageDataSet(…)

ImageDataSet loads/saves image data as numpy from an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.plotly.JSONDataSet(…)

JSONDataSet loads/saves a plotly figure from/to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.plotly.PlotlyDataSet(…)

PlotlyDataSet generates a plot from a pandas DataFrame and saves it to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.redis.PickleDataSet(key)

PickleDataSet loads/saves data from/to a Redis database.

kedro.extras.datasets.spark.DeltaTableDataSet(…)

DeltaTableDataSet loads data into DeltaTable objects.

kedro.extras.datasets.spark.SparkDataSet(…)

SparkDataSet loads and saves Spark dataframes.

kedro.extras.datasets.spark.SparkHiveDataSet(…)

SparkHiveDataSet loads and saves Spark dataframes stored on Hive.

kedro.extras.datasets.spark.SparkJDBCDataSet(…)

SparkJDBCDataSet loads data from a database table accessible via JDBC URL url and connection properties and saves the content of a PySpark DataFrame to an external database table via JDBC.

kedro.extras.datasets.tensorflow.TensorFlowModelDataset(…)

TensorflowModelDataset loads and saves TensorFlow models.

kedro.extras.datasets.text.TextDataSet(filepath)

TextDataSet loads/saves data from/to a text file using an underlying filesystem (e.g.: local, S3, GCS)

kedro.extras.datasets.tracking.JSONDataSet(…)

JSONDataSet saves data to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.tracking.MetricsDataSet(…)

MetricsDataSet saves data to a JSON file using an underlying filesystem (e.g.: local, S3, GCS).

kedro.extras.datasets.yaml.YAMLDataSet(filepath)

YAMLDataSet loads/saves data from/to a YAML file using an underlying filesystem (e.g.: local, S3, GCS).