RFC 5234 spec compliant robots.txt builder and parser. 🦾
Primary LanguageTypeScriptMIT LicenseMIT
No issues in this repository yet.