/islands-web-scraper

A Selenium based web-scraper for a statistics project (Summer 2020)

Primary LanguagePython

Islands Web Scraper

See the site

Installation

First, install the system requirements:

$ apt install firefox-geckodriver

Then, install the Python requirements:

$ pip3 install -r requirements.txt

Usage

First, create a file in the root of the repository called secrets.json w/ the following structure:

{
  "username": "USERNAME_HERE",
  "password": "PASSWORD_HERE"
}

Then, edit the settings.py file so that it fits your criteria

Finally, run the program!

$ python3 main.py

To Do

  • Add useful logging messages