/Web-Spider-Linux-shell-script

Generate a list of file links you can feed to wget for easy downloading! Mainly used for spidering web folders with lots of files. Can even generate a sitemap.txt or XML file for your website!

Primary LanguageShellOtherNOASSERTION

No issues in this repository yet.