/cosmicrawler

Cosmicrawler is crawler library for Ruby. It provides scalable asynchronous crawling by (http|file|etc) using EventMachine.

Primary LanguageRuby

No issues in this repository yet.