Scrapydd is a system for scrapy spiders distributed running and scheduleing system, including server and client agent.
Primary LanguagePythonApache License 2.0Apache-2.0