floreskul/pycr

Simple multi-processed crawler in Python