Aviya-Singh/End-to-End-ETL

This project for real-time smart city data processing using Docker, Apache Kafka, Apache Spark, and AWS. It features data simulation and streaming with Docker and Kafka, real-time processing using Apache Spark, and data storage and querying via AWS S3, Glue, and Athena. It also includes instructions for visualizing the processed data in Power BI.

Python