/data-engineering-zoomcamp-capstone-01

A dockerized 5 min. mini-batch data pipeline. Spark Structured Streaming: reading from Kafka to PostgreSQL as a sink DB. Airflow, Kafka, PySpark, PostgreSQL, Streamlit

Primary LanguagePython

Watchers