/protego

A pure-Python robots.txt parser with support for modern conventions.

Primary LanguageDIGITAL Command LanguageBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause

Stargazers

No one’s star this repository yet.