IPL Data Engineering

This is an End-to-End Data Engineering Project that using the IPL Dataset.

Pipeline Architecture

Screenshots

Snowflake Environment

Databricks Environment

Data Visualization

Tech Stack

Dataset: IPL-dataset from @data.world

Extract & Load Data: SnowSQL & Snowflake DB

Transform Data: Pyspark & Databricks