NodeJS robots.txt parser with support for wildcard (*) matching.
Primary LanguageJavaScriptMIT LicenseMIT