/message-loop-research

This is a small research project using Golang, Kafka, grpc and protobuf.

Primary LanguageGoMIT LicenseMIT

Message-Loop

This is a small research project using Golang, Kafka, grpc and protobuf.

Project Functionality

This loop is composed of two services that will pass one piece of data 3 times.

  • Alpha -> Beta via Kafka (perform simple transformation)
  • Beta -> Alpha via gRPC (perform simple transformation)
  • Alpha -> Beta via protobuf (perform simple transformation and log)

Project Goals

This project outlines simple methods to utilize the following technologies using Golang:

  • Inbound Kafka Messages
  • Outbound Kafka Messages
  • Protobuf
  • gRPC

Deployment and Execution

Placing a message on the queue

Using kafkacat, execute the following command to test the kafka message ingestion on the beta service:

# Example - make this correct
echo 'publish to partition 0' | kafkacat -P -b localhost:19092,localhost:29092,localhost:39092 -t foo -p 0