/ETL-pipeline

This is an ETL pipeline using Kaggle, Databricks and Snowflake

Primary LanguageJupyter Notebook

ETL pipeline using Kaggle, Databricks and Snowflake.

Description

This an ETL pipeline project using Kaggle dataset for extracting the Data, Databricks for Transforming Data and Snowflake that we gonna to loading Data.

Architecture

ETL pipeline

Programming language

  • Python

Tools and Technologies

  • Kaggle
  • Databricks
  • Snowflake

Screenshots

Kaggle Dataset

Kaggle

Databricks Enviorment

databricks

Snowflake Enviorment

snowflake

Publish Link of the Databricks Notebook

https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/3108667502176151/2402851953300314/6712313256190692/latest.html