/WarcMiddleware

WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.

Primary LanguagePythonOtherNOASSERTION

Watchers