getgauge/gauge.org

Create a robots.txt file

Closed this issue 7 years ago · 1 comments

nyuday commented 7 years ago

Need to stop crawling preview.gauge.org

sriv commented 7 years ago

Done. See https://preview.gauge.org/robots.txt