Distributed and concurrent web crawler.
Primary LanguageScalaApache License 2.0Apache-2.0
Distributed and concurrent implementation of a polite web crawler.