data-pipeline

Build a data pipeline with Kafka, Spark, Redis, Nodejs, Docker etc

Environment Setup

  1. Install docker and docker-compose
  2. Run docker-compose up in this directory
  3. It will setup Zookeeper, Kafka, Redis, Cassandra