jet/kafunk

Batch consumer fetch requests

Closed this issue · 1 comments

Currently, the consumer makes individual fetch requests per partition. This doesn't take advantage of request batching. Some steps:

  • Take partition assignments and determine a fetch strategy.
  • Broadcast fetched messages in-order per partition.
  • Take care of end of topic polling per partition.

Closed by #68