1stdibs's robots.txt This is 1stdibs's robots.txt file. You can also see it here: https://www.1stdibs.com/robots.txt