google/robotstxt

Issues

• Issues with Bazel build

  #58 opened a year ago by willcritchlow
  2

• SEOサイト

  #61 opened 6 months ago by oozekimarie
  0

• Docker image for robots

  #69 opened 6 months ago by peaceiris
  1

• Create git tag for the first release

  #68 opened 6 months ago by peaceiris
  1

• Installation for robots using Homebrew (brew)

  #67 opened 6 months ago by peaceiris
  2

• An encoding test does not appear to match the RFC?

  #64 opened 8 months ago by davepeck
  0

• gpyrobotstxt, a Python Native port of this repo

  #60 opened a year ago by CoconSe
  1

• duplicate function body

  #23 opened a year ago by raingart
  1

• Special characters * and $ not matched in URI

  #57 opened 2 years ago by sebastian-nagel
  0

• User-agent names in test ID_UserAgentValueCaseInsensitive to follow the standard

  #56 opened 2 years ago by sebastian-nagel
  5

• Update README build requirements

  #55 opened 2 years ago by Gianlo98
  1

• CMAKE Build failing after newest commit to abseil/abseil-cpp

  #34 opened 4 years ago by zuku1985
  6

• CMAKE_CXX_STANDARD 14

  #54 opened 2 years ago by dbugger29
  1

• googletest.git has tag main

  #44 opened 3 years ago by dbugger29
  2

• bazel test failed with `bazelisk`: Repository '@bazel_skylib' is not defined

  #52 opened 2 years ago by lucasassisrosa
  0

• Combination of Crawl-delay and badbot Disallow results in blocking of Googlebot

  #51 opened 3 years ago by mojmirdurik
  3

• Consider a WASM build

  #42 opened 3 years ago by danbri
  2

• Allow wider range of chars for valid user-agent identifier / 'product' token

  #46 opened 3 years ago by jimsmart
  13

• Google's robots.txt parser and matchet

  #45 opened 3 years ago by cephasoo
  0

• [redacted]

  #40 opened 3 years ago by alfodei22
  0

• [redacted]

  #39 opened 3 years ago by alfodei22
  0

• [redacted]

  #38 opened 3 years ago by alfodei22
  0

• [redacted]

  #37 opened 3 years ago by alfodei22
  0

• [redacted]

  #36 opened 3 years ago by alfodei22
  0

• [redacted]

  #41 opened 3 years ago by alfodei22
  1

• <redacted>

  #35 opened 4 years ago by Al-Foudai22
  2

• Crawl-Delay support?

  #33 opened 4 years ago by fluffy-critter
  1

• CMAKE compilation not working on Ubuntu 16.04

  #32 opened 4 years ago by juliend2
  0

• I think this comment is misleading

  #27 opened 5 years ago by willcritchlow
  1

• Library ported to Go

  #29 opened 5 years ago by jimsmart
  2

• A rust ported robotstxt

  #31 opened 5 years ago by Folyd
  0

• Should REP define the `X-Robots-Tag` header?

  #22 opened 5 years ago by Malvoz
  1

• Genetic Cloning

  #6 opened 5 years ago by urgent
  4