/crawler

Primary LanguageJavaScript

Crawl

Simple parallel URL crawler

Usage

./crawl https://itsgg.com -n 4

Run tests

npm test

Sample output