/dota_crawler

Crawler for dotapedia. Fills a Mongo and a PG database with game data.

Primary LanguagePython

Dota Crawler

Please run:

sudo pip install virtualenv
virtualenv .crawler
source .crawler/bin/activate
pip install -r requirements.txt
scrapy runspider herocrawl.py
scrapy runspider itemcrawl.py