xpresso/heroshi

Web crawler.

Python

Heroshi
The scalable web crawler.

See http://temoto.github.com/heroshi/ for more information.