gaoyuankidult/fetchurls

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

ShellMIT