[DataCatalog2.0]: Running pipeline with versioned datasets gives an error
Author: ElenaKhaustovaCreated May 15, 2025Updated Sep 18, 2026
LabelsIssue: Bug Report 🐞Component: IOComponent: Jupyter/IPython
Description
Running pipelines with versioned=True gives an error for all runners using feature-1.0.0 branch
The error exists in Kedro 0.19.12 too.
The following error happens when using SequentialRunner and ThreadRunner:
DatasetError: Save path
'/Users/Projects/Testing/kedrocatalog/data/02_intermediate/preprocessed_companies.parquet/2025-05-13T12.22.11.290Z/prepr
ocessed_companies.parquet' for
ParquetDataset(filepath=/Users/Projects/Testing/kedrocatalog/data/02_intermediate/preprocessed_companies.parquet,
load_args={}, protocol=file, save_args={}, version=Version(load=None, save='2025-05-13T12.22.11.290Z')) must not exist if versioning
is enabled.With ParallelRunner and SharedMemoryDataCatalog the error changes to:
DatasetError: Data for MemoryDataset has not been saved yet.Context
Found while https://github.com/kedro-org/kedro/issues/4699
Steps to Reproduce
Set versioned=True for datasets in catalog.yml and run pipelines via Python API:
default = pipelines.get("__default__")
tr = ThreadRunner()
tr.run(pipeline=ds, catalog=catalog) Source: kedro-org/kedro