/Films-ELT-pipeline

This is end-to-end data engineering project using some of the most powerful technologies like: dbt, Apache Airflow, Airbyte and Docker.

Primary LanguagePython

Films-ELT-pipeline

This is end-to-end data engineering project using some of the most powerful technologies like: dbt, Apache Airflow, Airbyte and Docker.

Architecture

dbt-airflow-airbyte.png

Data Modeling

Data-Modeling.jpg

Tech Stack

Programming Language: Python, SQL

Database: PostgreSQL

Data Transformation: dbt Cloud

Data Orchestration: Apache Airflow

Data Movement: Airbyte

Container Tool: Docker