/scrapy-simple-http-queue

Scrapy Plugin to use the simple http queue as the queue for the URLs in order to allow distributed crawling

Primary LanguagePython

No issues in this repository yet.