Data Engineering Youtube Project
-
Updated
Jun 29, 2023 - Jupyter Notebook
Data Engineering Youtube Project
This project is a data pipeline that ETL Reddit data into a Redshift data warehouse. The pipeline includes a combination of tools and services: Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.
Data engineering with a focus on AWS cloud services.
Add a description, image, and links to the amazon-glue topic page so that developers can more easily learn about it.
To associate your repository with the amazon-glue topic, visit your repo's landing page and select "manage topics."