This repository documents my experience with the DataTalksClub Zoomcamp data engineering course. It contains materials and assignments used to explore and apply essential concepts:
- Google Cloud Platform (GCP): Cloud-based auto-scaling platform by Google
- Google Cloud Storage (GCS): Data Lake
- BigQuery: Data Warehouse
- Terraform: Infrastructure-as-Code (IaC)
- Docker: Containerization
- SQL: Data Analysis & Exploration
- Mage: Workflow Orchestration
- dbt: Data Transformation
- Spark: Distributed Processing
- Kafka: Streaming
-
Module 6: Streaming
-
Weeks 7, 8, 9: Project
- Data Engineering Zoomcamp by DataTalksClub; GitHub main page: https://github.com/DataTalksClub/data-engineering-zoomcamp/?tab=readme-ov-file
- 2024 cohort playlist: https://www.youtube.com/watch?v=91b8u9GmqB4&list=PL3MmuxUbc_hKihpnNQ9qtTmWYy26bPrSb