robotViewer Whenever you view a site's robots.txt link this will allow you to click the links for quicker research.