Simple web crawler written in Python
Primary LanguagePython
I forked this from elsewhere and bent it to my will.