Only rotate proxy when banned or dead
Marow opened this issue · 0 comments
Marow commented
Hi, i have a list with 1000 proxies and over 200 spiders running same time.
I have set CONCURRENT_REQUESTS = 1 so i want each proxy running one time overall.
But i want also that each proxy is use until it gets banned or its dead or something. Now its running and changing on each request