Web crawler.
Primary LanguagePython
Heroshi The scalable web crawler. See http://temoto.github.com/heroshi/ for more information.