/StockData

Education project for the use of kafka, spark and cloud ml integration. Perhaps intzegrate elasticsearch as well.

Primary LanguagePython

Stock Data End-to-End Demo project

Purpose

Building a project from online course knowledge about Kafka, Spark and Cloud Integration.

Setup

  1. Download the S&P 500 dataset from kaggle.
  2. Unzip the file and put the csv file into python/data

ToDos

  1. Add python container that posts the postgres configurations to connect container as soon as the port is responding
  2. create streams in ksql with ksql client