Add robots.txt

[jasim]

Search engine spiders are consuming an enormous amount of bandwidth trying to spider every build status. Only the home page and builds list (if required) should be allowed for crawling.

[pahnin]

Hi, I fixed this, I suppose.
Here's is my commit message pahnin@7bc8414
and link to repo https://github.com/pahnin/goldberg

Regards