/scrapy-crawl-once

Scrapy middleware which allows to crawl only new content

Primary LanguagePythonMIT LicenseMIT

Stargazers

No one’s star this repository yet.