💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.
-
Updated
Apr 6, 2023 - Python
💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.
Use of Apache Airflow to backfill and schedule the load and analysis of raw data into Redshift data warehouse
Add a description, image, and links to the airflow-ui topic page so that developers can more easily learn about it.
To associate your repository with the airflow-ui topic, visit your repo's landing page and select "manage topics."