TeamHG-Memex/scrapy-rotating-proxies

Disable interval logging for DefaultSpider

Granitosaurus opened this issue · 0 comments

It's great that this middleware is enabled for DefaultSpider (i.e. scrapy shell) but interval logging messes up stdout and such when using scrapy shell comannd.
This can be avoided by using:

scrapy shell http://example.com -s ROTATING_PROXY_LOGSTATS_INTERVAL=999999  

but seems like it's not intentional functionality and it shouldn't be there in the first place.

I can submit a PR for this as I already isolated a bunch of my middlewares of DefaultSpider :)