crawler collection of python web crawlers and scrapers. They are mostly experimental and unmaintained. Due to changes to the sites they might not work.