Cicada scraper project fpr Python 2.7
To install:
sudo pip install -r requirements.txt
To run:
python scrape.py
urls.txt contains urls to scrape. Scrape.py will automatically follow all links and store them in out/
Set up CURL to make it scrape on interval-basis