/build-your-de-project

Build your 1st DE Project Session - July 2024

Build Your 1st Data Engineering Project (July 2024)

Hi 👋🏻 Have you noticed this repo is empty? Yep, it's for our Co-learning session. So let's make something beautiful in here.

Ready?

What is TheLearningDev?

What is it not?

  • This is not a bootcamp
  • This is not a workshop
  • This is not a meetup where people talk and talk and....
  • Definitely not a cohort-based course

What it is?

In every TheLearningDev session, we will get together, use a pre-existing resource, a book, or a blog post, try to follow it along, make mistakes, get stuck, get unstuck, and just enjoy the process of learning

image

What are we building

For this session, we will be using these two resources.

Don't overwhelm yourself, if you understand nothing, you're in the right place.

  1. https://www.startdataengineering.com/post/data-engineering-projects-with-free-template/
  2. https://www.startdataengineering.com/post/data-engineering-project-for-beginners-batch-edition/

Prepare Yourself

  1. You need to know Python, yes classes-level Python. If you don't already it's ok Keep think Python book next to you at all times. Google and ChatGPT everything
  2. You don't have to be a master of anything else, mark the event on your calendar and show up. That's it
  3. Notice and Remember this is not a bootcamp or your workshop. You can learn at your own pace with check-ins over Zoom.

Prepare Your Laptop

  1. Install Python
  2. Install Docker
  3. Clone this repo Beginner DE Project
  4. Fork this repo and clone it - You can use this to write things from scratch.
  5. Visual Studio code or any other code editor ready.

Introduce Yourself

  1. Introduce yourself here.
  2. Comment on someone else's introduction and make acquaintances

Got questions?

  1. Ask your questions here.
  2. Throughout the session, if you see a question that you can answer feel free too

Tentative Agenda

Event Date: 6th July 2024 (Saturday) (IST hours)

Please be on time. The Zoom will be live 10 mins before the event

  • 10:30 AM:: Join Zoom and Settle in
  • 10:40 AM - 11:00 AM - Understanding the Problem
  • 11:00 AM - 11:45 AM - Setting the repo
  • 11:45 AM - 12:00 PM - Discussions on pipeline development
  • 12:00 PM - 1:00 PM - Develop the pipeline
  • 1:00 PM - 1:15 PM - Discussing pipeline implementation
  • 1:15 PM - 1:30 PM - Sign off

If you've read this far and done all the steps, AMAZING! You're TheLearningDev, because reading things, trying them out and trusting the process are all the traits of TheLearningDev. Give yourself a pat on the back