benbjohnson/thesecretlivesofdata

Apache Kafka

benbjohnson opened this issue · 26 comments

benbjohnson commented

Overview

Status: Proposal

Apache Kafka is a scalable, distributed publish-subscribe messaging system. It allows organizations to use it as an event bus and decouple systems from one another.

Sections

  • Basics of Apache Kafka
  • Replication
  • Internals / Zookeeper interaction
dannykansas commented

+1 for this. Your raft explanation was magnificent. Thanks!

  • 👍29
  • ❤️8
benbjohnson commented

Update: I finally started working on this. The Raft visualization was time intensive so I've been trying to find a way to make the format useful while also making it easier to code up. I'm working on getting D3.js visualizations embeddable inside medium.com so that I can do a better narrative around the visualization. Something sort of similar to Mike Bostock's algorithm visualization post:

http://bost.ocks.org/mike/algorithms/

I'll post the narrative for review once I get it written up. I'd love some feedback at that point before I really dig into the visualization side.

  • 👍3
ongardie commented

Nice, looking forward to seeing what you come up with.

On Thu, Sep 18, 2014 at 2:02 PM, Ben Johnson notifications@github.com
wrote:

Update: I finally started working on this. The Raft visualization was
time intensive so I've been trying to find a way to make the format useful
while also making it easier to code up. I'm working on getting D3.js
visualizations embeddable inside medium.com so that I can do a better
narrative around the visualization. Something sort of similar to Mike
Bostock's algorithm visualization post:

http://bost.ocks.org/mike/algorithms/

I'll post the narrative for review once I get it written up. I'd love some
feedback at that point before I really dig into the visualization side.

—
Reply to this email directly or view it on GitHub
#4 (comment)
.

hauntedhost commented

Fantastic. Looking forward to it. Thanks for update.

benbjohnson commented

Really basic start to the Kafka post:

http://thesecretlivesofdata.com/kafka/basics/

Just some "intro to log processing" and a simple log visualization. I was going to post larger chunks but I figured that I'd get some feedback as I go. Feedback welcome!

benbjohnson commented

Also, my goal is to make the posts and visualizations accessible on mobile devices so feedback is welcome there too.

otoolep commented

Thanks for including me on this. Good to see it getting going. Nice introductory visual.

I would say that it makes more than just a software developer's job easier -- in fact, it makes system designers' job easier. It's bigger than just developers IMHO.

xo4n commented

+1

samebchase commented

This would be wonderful!

tobegit3hub commented

Still working on it? Need any help?

benbjohnson commented

@tobegit3hub thanks but i'm moving TSLD over to a video format and it's been slow to learn all the video tools. i'll hopefully start getting some videos out soon. :fingers_crossed: :)

  • 👍5
  • 😄2
tobegit3hub commented

Great! Thanks for all your contribution @benbjohnson 👍

GreedyWang commented

Thanks for all your contribution @benbjohnson 👍

jicahoo commented

@benbjohnson 👍 Very cool.

ding102992 commented

@benbjohnson 👍Fantastic.Looking forward for years.

wudyStudy commented

Looking forward for years.

  • 👍12
yourNameIsGood commented

Sounds really great and looking forward to it

NargiT commented

Wow just discover this! I Want MORE !

bowenpz commented

hey, is that still alive...?

NargiT commented

I don't think so 😢

Hongten commented

The Apache Kafka had been released 3.1.0 on 24 Jan 2022 which using the Kraft. Any update for this?

zwGithubStation commented

thx looking forward new subjects

NargiT commented

@zwGithubStation I am afraid this project is no more maintained 😢