TeamHG-Memex/scrapy-rotating-proxies

Use Queue to selec the next proxy

devfox-se opened this issue · 0 comments

Currently proxy is selected randomly, this is not as efficient since on a small set of addresses repetitions will happen more frequent.
Having a queue guarantees more evenly distributed resource usage.