Set up robots.txt to avoid indexing of test.digitalisiertedrucke.de
Closed this issue · 3 comments
fsteeg commented
Also beta.digitalisiertedrucke.de?
fsteeg commented
Deployed to staging: http://test.digitalisiertedrucke.de/robots.txt
Checked with http://tool.motoricerca.info/robots-checker.phtml
acka47 commented
+1
acka47 commented
I guess we should also disallow crawling beta.