Skip to content

skuschel/generatorpipeline

Repository files navigation

generatorpipeline

Parallelize your data-processing pipelines with just a decorator.

Tutorial

Please see the tutorial notebook for an overview of the functionality.

Installation

Python 2 is NOT supported. You must use python version 3.6 or higher!

  1. The recommended way is to create a python venv and install it into the venv. Create a new virtualenv by
python -m venv --system-site-packages ~/.venv/defaultpyvenv
  1. activate the environment using source ~/.venv/defaultpyvenv/bin/activate.

  2. Install into the venv

pip install generatorpipeline[full]@git+https://github.com/skuschel/generatorpipeline.git

Installation for developers

Follow steps 1 and 2 of the normal installation to create and activate a venv.

  1. git clone this repository
git clone git@github.com:skuschel/generatorpipeline.git
  1. Install in editable mode using
pip install -e .

Contributing

... is always welcome! Development and issue tracker can be found on github. Please report bugs to https://github.com/skuschel/generatorpipeline/issues