kedro.runner.SequentialRunner

class kedro.runner.SequentialRunner(is_async=False, extra_dataset_patterns=None)[source]

SequentialRunner is an AbstractRunner implementation. It can be used to run the Pipeline in a sequential manner using a topological sort of provided nodes.

Methods

run(pipeline, catalog[, hook_manager, ...])

Run the Pipeline using the datasets provided by catalog and save results back to the same objects.

run_only_missing(pipeline, catalog, hook_manager)

Run only the missing outputs from the Pipeline using the datasets provided by catalog, and save results back to the same objects.

__init__(is_async=False, extra_dataset_patterns=None)[source]

Instantiates the runner class.

Parameters:
  • is_async (bool) – If True, the node inputs and outputs are loaded and saved asynchronously with threads. Defaults to False.

  • extra_dataset_patterns (dict[str, dict[str, Any]] | None) – Extra dataset factory patterns to be added to the DataCatalog during the run. This is used to set the default datasets to MemoryDataset for SequentialRunner.

run(pipeline, catalog, hook_manager=None, session_id=None)

Run the Pipeline using the datasets provided by catalog and save results back to the same objects.

Parameters:
  • pipeline (Pipeline) – The Pipeline to run.

  • catalog (DataCatalog) – The DataCatalog from which to fetch data.

  • hook_manager (PluginManager | None) – The PluginManager to activate hooks.

  • session_id (str | None) – The id of the session.

Raises:

ValueError – Raised when Pipeline inputs cannot be satisfied.

Return type:

dict[str, Any]

Returns:

Any node outputs that cannot be processed by the DataCatalog. These are returned in a dictionary, where the keys are defined by the node outputs.

run_only_missing(pipeline, catalog, hook_manager)

Run only the missing outputs from the Pipeline using the datasets provided by catalog, and save results back to the same objects.

Parameters:
  • pipeline (Pipeline) – The Pipeline to run.

  • catalog (DataCatalog) – The DataCatalog from which to fetch data.

  • hook_manager (PluginManager) – The PluginManager to activate hooks.

Raises:

ValueError – Raised when Pipeline inputs cannot be satisfied.

Return type:

dict[str, Any]

Returns:

Any node outputs that cannot be processed by the DataCatalog. These are returned in a dictionary, where the keys are defined by the node outputs.