Proxies Info stucked so much times
Marow opened this issue · 0 comments
Marow commented
Is that normal?
[rotating_proxies.middlewares] INFO: Proxies(good: 7, dead: 0, unchecked: 990, reanimated: 3, mean backoff time: 0s)
I get this sooo much times... i have 1000 proxies and he check only 7 good in about 10 minutes?
Sometimes it works fine and after a few minutes it stops at that message what i post in code.
Than it looks like that
2020-02-10 22:13:11 [rotating_proxies.middlewares] INFO: Proxies(good: 7, dead: 0, unchecked: 990, reanimated: 3, mean backoff time: 0s)
2020-02-10 22:13:41 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 0 pages/min), scraped 252 items (at 9 items/min)
2020-02-10 22:13:41 [rotating_proxies.middlewares] INFO: Proxies(good: 7, dead: 0, unchecked: 990, reanimated: 3, mean backoff time: 0s)
2020-02-10 22:14:11 [rotating_proxies.middlewares] INFO: Proxies(good: 7, dead: 0, unchecked: 990, reanimated: 3, mean backoff time: 0s)
After a time, i dont know the time, it works again and than stopped a few moment later again with same problem