/awesome-kafka

A curated list of awesome things related to Apache Kafka

Creative Commons Zero v1.0 UniversalCC0-1.0


logo of kafka-awesome repository

Awesome Kafka Awesome

A curated list of awesome things related to Apache Kafka.

Contents

Libraries

Kafka

  • topicctl - A tool for easy, declarative management of Kafka topics. Includes the ability to "apply" topic changes from YAML as well as a repl for interactive exploration of brokers, topics, consumer groups, messages, and more.
  • sarama - Sarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later).
  • kadeck - Apache Kafka Monitoring, Kafka UI and data platform for Desktop or Web.
  • conduktor
  • mirus - Mirus is a cross data-center data replication tool for Apache Kafka.
  • kareldb - A Relational Database Backed by Apache Kafka.
  • kcache - An In-Memory Cache Backed by Apache Kafka.
  • kafka-lag-based-assignor - Kafka partition assignor that distributes lag evenly across a consumer group.
  • kafka-pixy - Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control.
  • Burrow - Kafka Consumer Lag Checking.
  • kafka-tools - A collection of tools for working with Apache Kafka.
  • schema-registry-ui - Web tool for Avro Schema Registry.
  • kafkacat - Generic command line non-JVM Apache Kafka producer and consumer.
  • kafka-jackson - Kafka Serializer, Deserializer, and Serde for Jackson JSON.
  • kafkahq - Kafka GUI for topics, topics data, consumers group, schema registry, connect and more.
  • secor - Secor is a service implementing Kafka log persistence.
  • reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
  • kafka-monitor
  • chaperone - A Kafka audit system.
  • uReplicator - Improvement of Apache Kafka Mirrormaker.
  • kafka-websocket
  • kafka-unit
  • cruise-control - Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a kafka cluster.
  • jocko - Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native).
  • hermes - Fast and reliable message broker built on top of Kafka.
  • kt - Kafka command line tool.
  • kafka-eagle - Used to monitor the consumer status of Kafka clusters, as well as offsets, metadata and other information.
  • dockerkafka - DoctorKafka is a service for Kafka cluster auto healing and workload balancing.
  • kasper - Kasper is a lightweight library for processing Kafka topics.
  • Yelp kafka-utils
  • kafka-spark-consumer
  • kafka-streams-cep - Complex Event Processing on top of Kafka Streams.
  • spring-kafka
  • ksql-machine-learning-udf
  • kafkabeat - Elasticsearch Beats for kafka.
  • sangrenel
  • Strimzi - Operator for deploying and running Apache Kafka on Kubernetes and OpenShift.
  • Kafka Manager - Web-based tool for managing a Kafka cluster.
  • Strimzi Kafka CLI - A CLI for Strimzi Kafka Operator.
  • Kafka Cluster Kraft Mode - DockerCompose - Workable kafka cluster with kraft mode using docker-compose.
  • Decaton - High throughput asynchronous task processing framework

Kafka UI

Kafka Streams

Kafka Connect

REST Proxy

  • kafka-rest - Confluent REST Proxy.
  • strimzi-http-bridge - Strimzi Kafka Bridge (AMQP & HTTP).
  • Zilla - An API gateway built for event-driven architectures and streaming that supports standard protocols such as HTTP, SSE, gRPC, MQTT and the native Kafka protocol.

KSQL

Schema Registry

Other Awesome Kafka

Kafkaesque

Resources

Learning

Blogs

Books