/Bitcoin-Kafka-Streaming

Kafka streaming application to stream bitcoin prices using the Coincap API

Primary LanguagePython

Bitcoin kafka

Bitcoin

Project Overview

Stream Real-time prices of bitcoin prices with a higher ranking on a one-minute interval using Apache Kafka.Streaming is enabled by use of the CoinCap API which displays real-time data of bitcoin prices.

Filter and transform the streaming data to only include the top ten ranked Bitcoins and order their prices in descending order.

Producer

The producer uses the CoinCap API to extract bitcoin prices on a one minute interval then later publishes the data to a Kafka topic for subscription by the consumer. The producer can be found here

Before data is ingeted into the kafka-topics, it is essential to change the data types from string to their respective data types for easier process of analysis and filtering of streaming data.

Consumer

The consumer subcribes to the producer topic and can be found here.

Transformer

The transformer filters the streaming data to only include the top ten bitcoin as well as filter the column names to have the neceesary columns for further analysis. It can be found here.

The following snippet shows how data moves downstream. transfomed