Parse robot directives within HTML meta and/or HTTP headers.
Primary LanguageJavaScriptMIT LicenseMIT