apchirinoc/protego
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command LanguageBSD-3-Clause
Stargazers
No one’s star this repository yet.
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command LanguageBSD-3-Clause
No one’s star this repository yet.