I'm starting my year 2023 with Data Engineering Zoomcamp by DataTalksClub.
This 9-week course focuses on data engineering and covers the following topics:
- Week 1: Introduction & Prerequisites (Docker, Terraform, Google Cloud Platform)
- Week 2: Workflow Orchestration with Prefect
- Week 3: Data Warehouse (BigQuery)
- Week 4: Analytics engineering with dbt
- Week 5: Batch processing with Spark (Spark Dataframes & SQL)
- Week 6: Streaming with Kafka (Kafka Connect and KSQL, Avro schemas)
- Weeks 7, 8 & 9: Putting everything we learned to practice into a project
- Weeks 7 and 8: working on our project
- Week 9: reviewing your peers
Below, the project architecture:
Link to the GitHub repository for the course details: https://github.com/DataTalksClub/data-engineering-zoomcamp