AttributeError: 'list' object has no attribute 'data_sets' when running spaceflights tutorial via CLI

[k3nnethfrancis]

I am running through the spaceflights tutorial to get myself familiar with Kedro and I've gotten stuck with this error when I attempt to run kedro run --node=preprocess_companies_node.

I've went through the steps and I seem to be following everything correctly, being sure to update functions/scripts where instructed.

Running 'kedro pipeline create data_processing' worked just fine. Added node functions to nodes.py. Updated the pipeline.py functions and the pipeline_registry.py file.

I've also confirmed I am running from the root dir kedro-tutorial.

Here is the full output from running the command kedro run --node=preprocess_companies_node:

(kedro_fun) C:\Users\kcavanagh\Desktop\Files\Programming\Python\Repositories\Kedro Spaceflights\kedro-tutorial>kedro run --node=preprocess_companies_node c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\setuptools\depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2022-02-24 16:52:42,441 - kedro.framework.cli.hooks.manager - INFO - Registered CLI hooks from 1 installed plugin(s): kedro-telemetry-0.1.3 Kedro-Telemetry is installed, but you have opted out of sharing usage analytics so none will be collected. 2022-02-24 16:52:42,526 - kedro.framework.session.store - INFO - read()not implemented forBaseSessionStore. Assuming empty store. 2022-02-24 16:52:42,792 - kedro.framework.session.session - INFO - ** Kedro project kedro-tutorial 2022-02-24 16:52:43,538 - kedro.framework.session.store - INFO - save()not implemented forBaseSessionStore. Skipping the step. Traceback (most recent call last): File "C:\Program Files\Python37\lib\runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "C:\Program Files\Python37\lib\runpy.py", line 85, in _run_code exec(code, run_globals) File "C:\Users\kcavanagh\Desktop\Files\Programming\Python\Repositories\Kedro Spaceflights\kedro_fun\Scripts\kedro.exe\__main__.py", line 9, in <module> File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\cli\cli.py", line 238, in main cli_collection() File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\click\core.py", line 829, in __call__ return self.main(*args, **kwargs) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\cli\cli.py", line 188, in main **extra, File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\click\core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\click\core.py", line 610, in invoke return callback(*args, **kwargs) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\cli\project.py", line 401, in run pipeline_name=pipeline, File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\session\session.py", line 345, in run pipeline = pipelines[name] File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\project\__init__.py", line 84, in inner self._load_data() File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\framework\project\__init__.py", line 128, in _load_data project_pipelines = register_pipelines() File "C:\Users\kcavanagh\Desktop\Files\Programming\Python\Repositories\Kedro Spaceflights\kedro-tutorial\src\kedro_tutorial\pipeline_registry.py", line 16, in register_pipelines data_processing_pipeline = dp.create_pipeline() File "C:\Users\kcavanagh\Desktop\Files\Programming\Python\Repositories\Kedro Spaceflights\kedro-tutorial\src\kedro_tutorial\pipelines\data_processing\pipeline.py", line 23, in create_pipeline name="preprocess_shuttles_node", File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\pipeline\modular_pipeline.py", line 118, in pipeline _validate_datasets_exist(inputs.keys(), outputs.keys(), parameters.keys(), pipe) File "c:\users\kcavanagh\desktop\files\programming\python\repositories\kedro spaceflights\kedro_fun\lib\site-packages\kedro\pipeline\modular_pipeline.py", line 62, in _validate_datasets_exist existing = {_strip_transcoding(ds) for ds in pipe.data_sets()} AttributeError: 'list' object has no attribute 'data_sets'

Any assistance is appreciated.

Thanks!

[antonymilne]

Hello! I am 99% sure this will be because you are looking at documentation for the latest version of kedro (0.17.7, which came out just a couple of days ago) but you are running a slightly older version of kedro. The best fix is to upgrade kedro: pip install -U kedro and pip show kedro to check what version you have 🙂