/slybot

Slybot web crawler

Primary LanguagePython

Slybot crawler

Slybot is a Python web crawler for doing web scraping. It's implemented on top of the Scrapy web crawling framework and the Scrapely extraction library.

The documentation (including installation and usage) can be found at: http://slybot.readthedocs.org/