/event-ingestion

Get's events from github and pushed to kafka bus

Primary LanguageJava

App ingestion

This Project will fetch the recent events from Github and pushed them to kafka topic

Start Zookeeper

  • bin/zookeeper-server-start.sh config/zookeeper.properties

Start Kafka Server

  • bin/kafka-server-start.sh config/server.properties

Create Kafka Topic

  • bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic eventmetrics

After all the above steps, start the application. There is a scheduler job running for every 5min to fetch data from Github. If you want to change the frequency of the scheduler, navigate to Producer class and try changing fixedRated value. @Scheduled(fixedRate = 60000)

Run the Application

mvn spring-boot:run