Experimenten met technieken zoals parquet files, arrow, duckDB en s3.
(Loosly build on link )
Create virtual environment with
python3 -m venv .datalake101
Deactivate default conda stuff first.
conda deactvate
Source this environment
source .datalake101/bin/activate