Documenting My Kafka Learning Journey!

image

I'm currently learning Kafka to grow my data engineering skills and dive deeper into my obsession with streaming data. In this repo you will find:

  • The resources I am referencing to learn.
  • Summaries of my learnings.
  • Code with documentation.
  • Recording of my live stream.

Please note that this shouldn't be considered a tutorial on Kafka, but rather documenting how I approach learning new technologies. There may be mistakes or misinterpretations, but if it's brought to my attention I will work to rectify it in this repo.

My Learning Process

In this section I will walk you through how I approach learning a new technology from limited knowledge. At a high level I use the following approach:

  1. Watching a high level video that is short and highlights the main premise of the technology.
  2. Watching a more in depth video on the technology.

Note: Watching the intro videos are the most important steps as it primes you for what's worth focusing on when you start reviewing more in-depth content.

  1. Reading a blog or article that starts to go into the nuances of the technology.
  2. Skimming a textbook on the technology to have a foundational grasp and know where to reference later on.
  3. Reading the original paper of technology, with an emphasis on understanding 1) the technical context of the time, 2) the problem statement that the authors are addressing, and 3) how this technology is uniquely positioned to solve the problem statement.
  4. Skimming the technology's official documentation with emphasis on the "getting started" section.
  5. Implementing a hello world project with the technology.
  6. Implementing a guided project with the technology.
  7. Implementing a personal project with the technology.
  8. Going back to the textbook on the technology and reading through with the context of building with the tool.

Kafka Learning Resources

Intro Videos

Intro Blogs

Kafka Textbook

Kafka Documentation

Hello World and Guided Projects

Summary of the Above Resources

Coming soon...

Livestream Recording

Live Stream Recording: https://youtu.be/rvTjw_F2YfA

Code Examples

Coming soon...