Scrapes a website and records whether links are successful.
Usage:
bin/links crawl BASE
Example:
bin/links crawl https://docs.mesosphere.com
Optional flags:
-s=SCOPE
: only scrape links from pages who's URL starts with BASE/SCOPEbin/links crawl https://docs.mesosphere.com -s=/1.12/installing
-o=OUTPUTDIR
: output results herebin/links crawl https://docs.mesosphere.com -o=my_dir