/ssence-crawler

Spider using Scrapy + Postgresql

Primary LanguagePython

ssence-crawler

Extract data from www.ssence.com, using scrapy & postgresql

setup

working environment : OSX 10.12.5

python env

conda create -name scrapy python=3
source activate scrapy
pip install -r requirements.txt

postgresql env

brew install postgresql
postgres -D /usr/local/var/postgres

install pyadmin4 for mac