A Django app for managing robots.txt files following the robots exclusion protocol
Primary LanguagePythonBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause