/scrapy-example

Messing around with scrapy

Primary LanguagePython

scrapy-example

An example project to get to know scrapy.

It goes to Python Challenge and locally stores everything from within that domain.

vagrant up
vagrant ssh
cd /home/vagrant/sync/scraper
scrapy crawl pychallenge