/robotstxt-util

RFC 9309 spec compliant robots.txt builder and parser. 🦾 No dependencies, fully typed.

Primary LanguageTypeScriptMIT LicenseMIT

Stargazers