TeamHG-Memex/scrapy-rotating-proxies

RETRY_HTTP_CODES is not taken into account

caffeinatedMike opened this issue · 0 comments

I'm using this middleware to rotate some proxies for a specific spider where I have a RETRY_HTTP_CODES defined in the spider's custom_settings dictionary. However, it seems this middleware is not respecting that list of http codes. For example, in the list I have the http code 403. Normally, when this http code is returned the request is retried. Shouldn't we have this middleware inherit that same behavior?