/yelp_crawler

big data analyze

Primary LanguagePython

yelp_crawler

run crawler to get yelp stores data, not the whole yelp data.

#run in shell

  • use run.sh to run the spider
  • remenber to change the path of scrapy

##other command

  • scrapy crawl yelp -o yelp.json -t json
  • scrapy crawl yelp -o yelp.csv -t csv

tech