/amzn

国外闪购网站商品爬取

Primary LanguagePython

Amzn project

This project is created for an umbrella subprojects that related to favbuy's phase-1 background tasks.

  • amzn -> a prototype crawler using scrapy
  • scripts -> some helpers/benchmark scripts
  • pystorm -> a twitter-storm like cluster computing/pipeline computing framework