Data Dynamo

YouTube video demonstration

https://youtu.be/5Gk4hfStHnI

The project for processing the large dataset of weather data and calculate:

  1. Heat Index
  2. Heat Stress Index
  3. Wind Chill Index

General information

Language / Framework

  • Java Oracle OpenJDK 17
  • Spring Boot 3.2.2
  • RabbitMQ

DBMS

  • PostgreSQL

Architecture

Untitled Diagram drawio (1)

Usage

Send request to Producer module

POST /api/dataset/upload

form-data: file

Response:

200

OK!

Project Screenshots:

Dataset CSV file example

Screenshot 2024-08-02 at 01 56 17

Dataset parsing

csv_proc

Weather metadata calculations

calculate

Weather data sending to the queue

sending_data