Crawl pages witin a domain, reporting any page that returns a bad response code
Usage:
> crawl [options] domain
-s, --start /home,/about Starting path(s), defaults to /
-u, --username username Basic auth username
-p, --password password Basic auth password
-v, --verbose Give details when crawling
-m, --markup Validate markup
-h, --help Show this message
Example:
> crawl http://alphasights.com --start=/no-such-page --verbose
Adding /no-such-page
Fetching /no-such-page ...
Pages with errors:
/no-such-page found on the command line - Status code: 404