Simple multi-processed crawler in Python
Simple multi-processed crawler in Python. Requirements: lxml (available in pip)