x-robots-tag

There are 4 repositories under x-robots-tag topic.

  • lerni/folderindex

    Silverstripe Module to set X-Robots-Tag noindex, nofollow, noimageindex, noarchive, and nosnippet for files in folders and sub-folders when ShowInSearch is unchecked.

    Language:PHP2331

  • VIPnytt/UserAgentParser

    User-Agent parser for robots.txt, X-Robots-tag and Robots-meta-tag rule sets

    Language:PHP1202

  • toimik/RobotsProtocol

    Parsers for robots.txt (aka Robots Exclusion Standard / Robots Exclusion Protocol), Robots Meta Tag, and X-Robots-Tag

    Language:C#0200

  • uretgec/roboindex-checker

    Website meta tag checker tool made by both node and golang for my education

    Language:Go20