A simple bulk web archiver
(You will need to chmod +x save.sh spn.sh
)
./save.sh "initial URL"
This will request a save of all files within one level of subdirectories to the original URL.
Special thanks go to overcast07 for their wayback-machine-spn-scripts, which is used to perform the saves.
The process is slow, especially for websites with a lot of content. It nonetheless is a method to reliably archive more content than the "save outlinks" option of archive.org (which also requires a registered account).
wget
, grep
, awk