/scrapy-emergency-data-finland

end-to-end emergency data scrapy project with geographical data visualizetion.

Primary LanguagePython

scrapy-emergency-data-finland

Scrapy spider project for emergency & incident data collection of Finland.

Visit the interactive map: Scrapy Emergency Data Finland 🖱️

Project Features

  1. Scraping: crawl and scrape emergency and incident data from website.
    1. Tracking & blocking prevention: Integrated with ScrapeOps API for user-agent & headers creation.
  2. Cleaning: Scrapy Items and Item Pipelines to clean and structure the data.
  3. Storage: Save the cleaned data into CSV files for further analysis.
  4. Visualization: Geographical distribution of incidents using Folium maps.