Geeks
SpiritQuaddicted
/
robots-relapse
Downloading robots.txt files for science!
Primary Language
Shell
robots-relapse GitHub
Markdown
Readme
2
Issues
2
Stargazers
3
Watchers
Issues
Open issue
Switch to https?
#2 opened
3 years ago
by
SpiritQuaddicted
0
Open issue
Missing www. handling is leading to bad grabs
#1 opened
3 years ago
by
SpiritQuaddicted
0