robots.txt

[ljm42]

To keep Unraid servers from being indexed by search engines, please consider adding a robots.txt in /usr/local/emhttp that contains:

User-agent: *
Disallow: /

and then adding this to rc.nginx to serve the file without requiring authentication:

#
# robots.txt available without authentication
#
location = /robots.txt {
    auth_basic off;
    allow all;
}

[eschultz]

We added that block to rc.nginx and @bergware added robots.txt. Thanks guys!

[ljm42]

great! this should keep the well-behaved robots away without giving away any details to the bad bots.