/Real-Time-Twitter-Analysis---Spark-Streaming-and-Kafka

A Real Time Twitter Analysis application that uses a Kafka broker to consume data from Twitter using Tweepy and stores it in a Kakfa Broker . The consumer is a Spark Streaming Application that ingests streaming data from Kakfa Topics, performs analysis and writes them into Elasticsearch and Kibana for visualization.

Primary LanguageJupyter Notebook

Twitter-Analysis---Spark-Streaming-and-Kafka

A Real Time Twitter Analysis application that uses a Kafka broker to consume data from Twitter using Tweepy and stores it in a Kakfa Broker . The consumer is a Spark Streaming Application that ingests streaming data from Kakfa Topics, performs analysis and writes them into Elasticsearch and Kibana for visualization.

Pending : Work in progress. Files to be updated