siddharth-nandagopal/realtime-sentiment-stream

This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka. It covers each stage from data acquisition, processing, sentiment analysis with ChatGPT, production to kafka topic.

Python