real-time-data-processing

There are 20 repositories under real-time-data-processing topic.

  • quix-streams

    quixio/quix-streams

    Python Streaming DataFrames for Kafka

    Language:Python1.5k1712091

  • emqx/mqtt-to-kafka

    Streaming IoT data into Confluent/Kafka using MQTT and EMQX | MQTT Kafka Integration

    Language:Makefile18804

  • venkat-0706/EmotionXpert-PyTorch

    Facial Expression Recognition using Deep Learning. Keywords: Python, CNN, Image Classification, Keras, TensorFlow, Emotion Detection.

    Language:Jupyter Notebook15100

  • alireza-heidarii/Real-Time-Data-Cleaning-Pipeline-for-Medical-and-Healthcare-Data

    A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

    Language:Python13200

  • codeterrayt/StreamGuard

    StreamGuard is a high-performance data management script using Kafka and MongoDB to efficiently handle and process real-time data streams. Ideal for scenarios like live GPS tracking, it features real-time data processing, reduced database load, and bulk data insertion.

    Language:JavaScript4100

  • hawa1222/real-time-data-processing

    Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated with Docker. This pipeline fetches, processes, stores, and visualises stock data.

    Language:Python4201

  • evans25575/Real-time-stock-analysis-pipeline

    This project builds a real-time data pipeline that ingests, processes, and stores data using Apache Kafka, Apache Spark, and MySQL. It simulates streaming data, processes it in real time, and saves the results for analysis. Automated with Apache Airflow, it highlights expertise in data engineering and real-time data processing.

    1

  • quixio/community-highlights

    Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

    Language:Python1201

  • rohancodestack/Coin-Market-API

    A Python-based graphical user interface (GUI) application for managing and visualizing cryptocurrency portfolios. This user-friendly application fetches real-time data from the CoinMarket API and provides an intuitive interface to track and analyze the value of your cryptocurrency assets.

    Language:HTML110

  • Willie-Conway/Meta-Database-Engineer-Portfolio

    "🌟 Portfolio showcasing projects and skills acquired through the Meta Database Engineer Professional Certificate program🎓, including data modeling 📊, SQL analysis 📝, and data visualization 📈."

    Language:Python1

  • YashBoda/AInvest

    AInvest is an AI-powered agent that analyzes stock performance using real-time data and news. It leverages LLMs with tools like yFinance, Tavily, and Google News to autonomously plan, fetch, and interpret financial insights—offering intelligent investment guidance based on market trends, returns, volatility, and sentiment.

    Language:Jupyter Notebook1

  • Karthikrgpt/Car_Black_Box

    The concept of Black Box is mainly heard by us in case of Aero-planes. Upon a catastrophe the Black Box is used to analyze the root cause of the issue. However, the purpose of Black Box can go beyond catastrophe analysis.

    Language:SWIG00

  • MichalBures-OG/RIoT-IS

    Bachelor thesis project of Michal Bureš made at BUT FIT.

    Language:Go0200

  • nessmahm/SparkKafka-Real-Time-Brand-Trend-Analysis

    A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.

    Language:Java00

  • SalmaHisham/KafKa-Hadoop-Spark-cluster-for-Analytics

    This project offers a dual approach to understanding e-commerce customer behavior through: Batch data analysis and Real-time data processing.

    Language:HTML0000

  • stereosky/community-highlights

    Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

    Language:Python0000

  • AndyZzzZzzZzz/ScholarSerpent

    A Python-based academic performance management app with a dynamic UI using Tkinter and ttkbootstrap. Features include secure SQLite storage, user authentication, real-time course info via SFU API, and Docker deployment for cross-platform compatibility.

    Language:Python10

  • Lucky-akash321/Data-Engineering-Taxi-Data

    The Data-Engineering-Project-Taxi-data involves analyzing and processing taxi data to extract valuable insights for business optimization. It includes building ETL pipelines, data modeling, and real-time analytics.

    Language:HTML

  • mrsamsonn/ADAS-lane-detection

    Deep learning-based lane detection system using convolutional neural networks (CNN) to detect lanes in road videos. The model processes video input, performs lane detection, and outputs a video with detected lane markings overlaid.

    Language:Python

  • night-fury-me/real-time-vehicle-data-processing

    A repository that contains implementation of a Real-Time Vehicle Data Processing Pipeline that efficiently manages and analyzes vehicle data through a cohesive system.

    Language:Python10