I'm currently learning Kafka to grow my data engineering skills and dive deeper into my obsession with streaming data. In this repo you will find:
- The resources I am referencing to learn.
- Summaries of my learnings.
- Code with documentation.
- Recording of my live stream.
Please note that this shouldn't be considered a tutorial on Kafka, but rather documenting how I approach learning new technologies. There may be mistakes or misinterpretations, but if it's brought to my attention I will work to rectify it in this repo.
In this section I will walk you through how I approach learning a new technology from limited knowledge. At a high level I use the following approach:
- Watching a high level video that is short and highlights the main premise of the technology.
- Watching a more in depth video on the technology.
Note: Watching the intro videos are the most important steps as it primes you for what's worth focusing on when you start reviewing more in-depth content.
- Reading a blog or article that starts to go into the nuances of the technology.
- Skimming a textbook on the technology to have a foundational grasp and know where to reference later on.
- Reading the original paper of technology, with an emphasis on understanding 1) the technical context of the time, 2) the problem statement that the authors are addressing, and 3) how this technology is uniquely positioned to solve the problem statement.
- Skimming the technology's official documentation with emphasis on the "getting started" section.
- Implementing a hello world project with the technology.
- Implementing a guided project with the technology.
- Implementing a personal project with the technology.
- Going back to the textbook on the technology and reading through with the context of building with the tool.
Intro Videos
Intro Blogs
- SAI #09: Kafka - Use Cases, Pre Machine Learning Data Quality and more...
- Getting started with Apache Kafka in Python
Kafka Textbook
Kafka Documentation
Hello World and Guided Projects
- Apache Kafka Quickstart
- Getting Started with Apache Kafka and Python
- How to build your first Apache KafkaProducer application
- How to build your first Apache KafkaConsumer application
Coming soon...
Live Stream Recording: https://youtu.be/rvTjw_F2YfA
Coming soon...