Spodermen
A dumb site crawler to highlight broken links and faulty routes.
Searches for href attributes in HTML content and follows any links on the
same domain. Reports the HTTP status code, content length and request duration
of all crawled URLs.
Usage
$ ./spodermen https://github.com/cavaliercoder/spodermen
Starting worker 4
Starting worker 2
Starting worker 3
Starting worker 1
GET /cavaliercoder/spodermen 200 48600 1538
Dolan, y u do dis?
Reviews
Terrible. Don't use it.
- Ryan Armstrong