A crawler that curls a list of urls and logs the https response status
Add urls to crawl to a urls.txt file , seperated by a newline in the same directory as the statusChecker.sh script
https://www.google.com
https://news.ycombinator.com/
https://xkcd.com/
https://slashdot.org/
http://scanme.nmap.org/
Run the script
$ sh statusChecker.sh
A file with the results will be outputted