/web_scraping

Hackathon project for collecting data on wine prices from various online shops and present the data on a dashboard

Primary LanguageJavaScript

Hackathon Sogrape 🍇

This challenge is multifaceted, encompassing two key dimensions: the Technical Dimension (webscraping) and the Visualization and Interaction Dimension (dashboard). It requires a range of skills, including web scraping, data management, and interface design. The ultimate goal is to create a comprehensive solution that is user-friendly, even for professionals without technical expertise, while also paving the way for the global expansion of this program to track and harvest data from wine markets worldwide.

For this beta version or minimum viable product (MVP), data is tracked from three prominent websites:

  • Continente Online
  • Garrafeira Soares
  • Supermercado El Corte Inglés

The selected products for initial monitoring include:

  • Mateus Rose Original
  • Mateus Sparkling Rosé
  • Herdade do Peso Trinca Bolotas Tinto
  • Casa Ferreirinha Papa Figos Branco
  • Lancers Vinho Rosé
  • Defesa do Esporao Tinto

Team members:

  • asousa-n (dashboard)
  • damachad (webscraping)
  • dcaetano (database and webscraping)
  • gamado-x (documentation and webscraping)

Note - You can find a README for the webscraping in the respective directory