donflopez/spiderhunt
Node crawler based on simplecrawler but with a distributed queue using rabbitmq and redis for a focused crawling.
JavaScript
Node crawler based on simplecrawler but with a distributed queue using rabbitmq and redis for a focused crawling.
JavaScript