mt3/scrapy-simple-http-queue
Scrapy Plugin to use the simple http queue as the queue for the URLs in order to allow distributed crawling
Python
Scrapy Plugin to use the simple http queue as the queue for the URLs in order to allow distributed crawling
Python