/lfhack2016

crawler for lf tech hackathon 2016

Primary LanguagePythonMIT LicenseMIT

Usage

Notes on Installation

Scrapy requires Python 2.7 to work

Installation ( virtualenv )

> virtualenv .
>

Installation ( Windows )

> scripts\activate.bat
> pip install scrapy
> scrapy crawl merojob -t json -o output.json

Installation ( Linux/MacOSX )

$ source ./bin/activate
$ pip install scrapy
$ scrapy crawl merojob -t json -o output.json