apache-kafka

There are 1422 repositories under apache-kafka topic.

  • debezium/debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

    Language:Java11.8k21402.7k
  • kafka-ui

    provectus/kafka-ui

    Open-Source Web UI for Apache Kafka Management

    Language:Java11.3k741.8k1.3k
  • automq

    AutoMQ/automq

    AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

    Language:Java7k51555489
  • console

    redpanda-data/console

    Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

    Language:TypeScript4.1k46641391

  • karafka/karafka

    Ruby and Rails efficient Kafka processing framework

    Language:Ruby2.2k291.1k186

  • OryxProject/oryx

    Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

    Language:Java1.8k206205405
  • kafka-ui

    kafbat/kafka-ui

    Open-Source Web UI for managing Apache Kafka clusters

    Language:Java1.5k11471167

  • Parsely/pykafka

    Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

    Language:Python1.1k82553225

  • confluentinc/cp-all-in-one

    docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

    Language:Python1.1k20159702

  • deviceinsight/kafkactl

    Command Line Tool for managing Apache Kafka

    Language:Go9602112092

  • fgeller/kt

    Kafka command line tool that likes JSON

    Language:Go9551995103

  • confluentinc/cp-helm-charts

    The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

    Language:Mustache796302309849

  • confluentinc/librdkafka

    The Apache Kafka C/C++ library

    Language:C7741483.2k3.2k

  • Farfetch/kafkaflow

    Apache Kafka .NET Framework to create applications simple to use and extend.

    Language:C#74728179131

  • miguno/kafka-storm-starter

    [PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

    Language:Scala7249112329

  • artie-labs/transfer

    Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.

    Language:Go67194440

  • gvolpe/trading

    💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

    Language:Scala64712576

  • mfontanini/cppkafka

    Modern C++ Apache Kafka client library (wrapper for librdkafka)

    Language:C++63830184215

  • infoslack/awesome-kafka

    A list about Apache Kafka

    581301165

  • zarusz/SlimMessageBus

    Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

    Language:C#5721416280

  • joowani/kq

    Kafka-based Job Queue for Python

    Language:Python571111423

  • tansu-io/tansu

    Apache Kafka® compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake

    Language:Rust48169814

  • rjurney/Agile_Data_Code_2

    Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

    Language:Jupyter Notebook4604399307

  • streamnative/kop

    Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

    Language:Java45141457143

  • oslabs-beta/Kafka-Sprout

    :rocket: Web GUI for Kafka Cluster Management

    Language:Java43081024

  • kcctl/kcctl

    A modern and intuitive command line client for Kafka Connect

    Language:Java409711545

  • karafka/rdkafka-ruby

    Modern and performant Kafka client library for Ruby based on librdkafka

    Language:Ruby39511256123

  • YunaiV/incubator-rocketmq

    带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?github

    Language:Java369320307

  • littlehorse-enterprises/littlehorse

    LittleHorse Kernel: A Platform for Distributed Event-Driven or Orchestrated Applications.

    Language:Java352845411

  • raystack/firehose

    Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

    Language:Java341124462

  • miguno/wirbelsturm

    [PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

    Language:Shell328363772
  • kouncil

    Consdata/kouncil

    Powerful dashboard for your Kafka. Monitor status, manage groups, topics, send messages and diagnose problems. All in one user friendly web dashboard.

    Language:TypeScript285254317

  • raystack/dagger

    Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

    Language:Java275156242

  • airscholar/e2e-data-engineering

    An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

    Language:Python27348117

  • karafka/waterdrop

    Standalone Karafka library for producing Kafka messages

    Language:Ruby271914740
  • jikkou

    streamthoughts/jikkou

    The Open source Resource as Code framework for Apache Kafka. Jikkou helps you implement GitOps for Kafka at scale!

    Language:Java248818121