travisjeffery/jocko

is kafka's zero copy already implemented?

sunface opened this issue · 4 comments

Great project! But i have't seen any content about kafka's zero copy

Also curious about this. Seems like the answer is "no" at the moment, looking at the commitlog sub-package.

Kafka relies on the "sendfile" syscall for the zero-copy and seems important for consumer groups implementation.

also what I have seen missing is the partitions or shards there is no support for partitions, which is really vital for scalability

Jocko definitely has partitions. But no it doesn't support zero copy because there's no good implementation of zero copy for Go yet.