Disable indexing for paste detail page
driesvints opened this issue · 2 comments
driesvints commented
Pastes shouldn't be indexed in Google. Only the landing page.
bvipul commented
@driesvints the link is not working..
driesvints commented
Hmm seems like the thread was removed. Problem atm is that the pastes get indexed by google so we should update the robots.txt file to don't crawl the pastes, only the main landing page.