/Data-Engineering-Nanodegree

Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift, Data Lake with Spark and Data Pipeline with Airflow.

Primary LanguageJupyter Notebook

Data Engineering Nanodegree

All projects of Udacity's Data Engineering Nanodegree.

Projects

Data Modeling

Learn to create relational and NoSQL data models to fit the diverse needs of data consumers. Use ETL to build databases in PostgreSQL and Apache Cassandra.

DATA MODELING WITH POSTGRES

DATA MODELING WITH APACHE CASSANDRA

Cloud Data Warehouses

Sharpen your data warehousing skills and deepen your understanding of data infrastructure. Create cloud-based data warehouses on Amazon Web Services (AWS).

BUILD A CLOUD DATA WAREHOUSE

Spark and Data Lakes

Understand the big data ecosystem and how to use Spark to work with massive datasets. Store big data in a data lake and query it with Spark.

BUILD A DATA LAKE

Data Pipelines with Airflow

Schedule, automate, and monitor data pipelines using Apache Airflow. Run data quality checks, track data lineage, and work with data pipelines in production.

DATA PIPELINES WITH AIRFLOW

Capstone Project

Combine what you've learned throughout the program to build your own data engineering portfolio project.

DATA ENGINEERING CAPSTONE