apache-kafka

There are 1205 repositories under apache-kafka topic.

  • debezium/debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

    Language:Java10.7k21702.5k
  • kafka-ui

    provectus/kafka-ui

    Open-Source Web UI for Apache Kafka Management

    Language:Java9.9k681.8k1.2k
  • console

    redpanda-data/console

    Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

    Language:TypeScript3.8k47589352

  • karafka/karafka

    Ruby and Rails efficient Kafka processing framework

    Language:Ruby2.1k32957179

  • OryxProject/oryx

    Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

    Language:Java1.8k208205405

  • Parsely/pykafka

    Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

    Language:Python1.1k78555232

  • confluentinc/cp-all-in-one

    docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

    Language:Python96917855684

  • fgeller/kt

    Kafka command line tool that likes JSON

    Language:Go9471994101

  • deviceinsight/kafkactl

    Command Line Tool for managing Apache Kafka

    Language:Go8302410779

  • confluentinc/cp-helm-charts

    The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

    Language:Mustache790288309843

  • miguno/kafka-storm-starter

    [PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

    Language:Scala7259112330

  • Farfetch/kafkaflow

    Apache Kafka .NET Framework to create applications simple to use and extend.

    Language:C#65428174119

  • gvolpe/trading

    💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

    Language:Scala63112571
  • kafka-ui

    kafbat/kafka-ui

    Open-Source Web UI for managing Apache Kafka clusters

    Language:Java623827081

  • mfontanini/cppkafka

    Modern C++ Apache Kafka client library (wrapper for librdkafka)

    Language:C++60232184207

  • artie-labs/transfer

    Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.

    Language:Go60194229

  • infoslack/awesome-kafka

    A list about Apache Kafka

    579311163

  • joowani/kq

    Kafka-based Job Queue for Python

    Language:Python572121424

  • zarusz/SlimMessageBus

    Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

    Language:C#4801514378

  • rjurney/Agile_Data_Code_2

    Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

    Language:Jupyter Notebook4584599308

  • streamnative/kop

    Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

    Language:Java45244457137

  • oslabs-beta/Kafka-Sprout

    :rocket: Web GUI for Kafka Cluster Management

    Language:Java43091024

  • kcctl/kcctl

    A modern and intuitive command line client for Kafka Connect

    Language:Java384811445

  • YunaiV/incubator-rocketmq

    带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?github

    Language:Java367330303

  • karafka/rdkafka-ruby

    Modern and performant Kafka client library for Ruby based on librdkafka

    Language:Ruby35912206122

  • miguno/wirbelsturm

    [PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

    Language:Shell330363772

  • raystack/firehose

    Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

    Language:Java329144460

  • confluentinc/librdkafka

    The Apache Kafka C/C++ library

    Language:C2951133.1k3.2k
  • kouncil

    Consdata/kouncil

    Powerful dashboard for your Kafka. Monitor status, manage groups, topics, send messages and diagnose problems. All in one user friendly web dashboard.

    Language:TypeScript271274117

  • raystack/dagger

    Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

    Language:Java267156241

  • karafka/waterdrop

    Standalone Karafka library for producing Kafka messages

    Language:Ruby2591113939

  • Azure/azure-event-hubs-for-kafka

    Azure Event Hubs for Apache Kafka Ecosystems

    Language:Java23133147213
  • jikkou

    streamthoughts/jikkou

    The Open source Resource as Code framework for Apache Kafka. Jikkou helps you implement GitOps for Kafka at scale!

    Language:Java2111015521

  • airscholar/e2e-data-engineering

    An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

    Language:Python2043792

  • kafkakru/meetup

    Kafka 한국 사용자 모임에서 운영하는 meetup repository

    20350029
  • go-notify

    Harry-027/go-notify

    An email automation solution, written in Golang.

    Language:Go19411121