anubhavp28/protego
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command LanguageBSD-3-Clause
No issues in this repository yet.
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command LanguageBSD-3-Clause
No issues in this repository yet.