/ELT-IPL

This is an End-to-End Data Engineering Project that using the IPL Dataset.

Primary LanguageJupyter Notebook

IPL Data Engineering

This is an End-to-End Data Engineering Project that using the IPL Dataset.

Pipeline Architecture

IPL.png

Screenshots

Snowflake Environment

Screenshot-from-2024-04-27-14-09-35.png

Databricks Environment

Screenshot-from-2024-04-28-13-01-33.png

Data Visualization

Screenshot-from-2024-04-28-13-02-10.png

Screenshot-from-2024-04-28-13-02-26.png

Tech Stack

Dataset: IPL-dataset from @data.world

Extract & Load Data: SnowSQL & Snowflake DB

Transform Data: Pyspark & Databricks