/scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Primary LanguagePythonMIT LicenseMIT

Stargazers

No one’s star this repository yet.