/spider

this is my first project with Bowen Nie

Primary LanguagePython

JDSpider

install scarpy component

  • install python virtual enironment
    1. #pip install virtualenv
    2. create your virtual python env #virtualenv $env_dirname
    3. active your env, for windows #cd $env_dirname and #Scripts\activate.bat
    4. if you get any problem you will see virtualenv problem
  • install scrapy
    1. #pip install scrapy

run JDSpider

  1. #git clone https://github.com/zt900403/spider.git JDSpider
  2. #cd JDSpider
  3. #scrapy crawl JDSpider --nolog