/Azure-Olympics-Analysis-Data-Engineering-End-to-End-Project

This is a End-to-End Azure Data Engineering Project | Analysis on the entire ETL Pipeline - Azure Factory, Azure Lake Gen 2, Databricks, Azure Synapse Analytics & Dashboards

Primary LanguageJupyter Notebook

Azure-Olympics-Analysis-Data-Engineering-End-to-End-Project

This is a End-to-End Azure Data Engineering Project | Analysis on the entire ETL Pipeline - Azure Data Factory, Azure Lake Gen 2, Azure Databricks, Azure Synapse Analytics.

  1. Azure Data Factory-
1 Data Factory Github Data Ingestion
  1. Azure Data Lake Gen2 Raw Data Store-
2 Data Lake Gen2- Raw Data Store
  1. Azure Data Bricks Transformation-
3 Databricks Transformation
  1. Azure Data Lake Gen2 Transformed Data Store-
4 Data Lake Gen2- Transformed Data Stored
  1. Azure Synapse Analytics-
5 Data Synapse Analytics using Queries