kedro.contrib.io.transformers.ProfileTimeTransformer

class kedro.contrib.io.transformers.ProfileTimeTransformer[source]

Bases: kedro.io.transformers.AbstractTransformer

A transformer that logs the runtime of data set load and save calls

Methods

ProfileTimeTransformer.load(data_set_name, load) Wrap the loading of a dataset.
ProfileTimeTransformer.save(data_set_name, …) Wrap the saving of a dataset.
__init__

Initialize self. See help(type(self)) for accurate signature.

load(data_set_name, load)[source]

Wrap the loading of a dataset. Call load to get the data from the data set / next transformer.

Parameters:
  • data_set_name (str) – The name of the data set being loaded.
  • load (Callable[[], Any]) – A callback to retrieve the data being loaded from the data set / next transformer.
Return type:

Any

Returns:

The loaded data.

save(data_set_name, save, data)[source]

Wrap the saving of a dataset. Call save to pass the data to the data set / next transformer.

Parameters:
  • data_set_name (str) – The name of the data set being saved.
  • save (Callable[[Any], None]) – A callback to pass the data being saved on to the data set / next transformer.
  • data (Any) – The data being saved
Return type:

None