zytedata/zyte-spider-templates-project

OffsiteMiddleware is a downloader middleware now

Closed this issue 11 days ago · 1 comments

wRAR commented 2 months ago

We disable scrapy.spidermiddlewares.offsite.OffsiteMiddleware but we should also disable scrapy.downloadermiddlewares.offsite.OffsiteMiddleware

kmike commented 11 days ago

This is handled by the addon: https://github.com/zytedata/zyte-spider-templates/blob/3f0a47c10de376e68be864e27d38a3520b4eace9/zyte_spider_templates/_addon.py#L147.