PyWCrawler
Simple python webCrawler written for fun lot of improvements can be made :)
usage: pyCrawler.py [-h] [-sd SCAN_DELAY] [-d] [-l LINK]
optional arguments: -h, --help show this help message and exit -sd SCAN_DELAY, --scan-delay SCAN_DELAY Time delay between requests in scan threads -d, --debug Debug Mode -l LINK, --link LINK Entry link url