/RobotsDisallowed

A curated list of the most common and most interesting robots.txt disallowed directories.

Primary LanguageShell

This repository is not active