WhichBrowser/Parser-PHP

Removing support for `Gocrawl` detection

summercms opened this issue · 0 comments

The user agent for Gocrawl is as follows:

Googlebot (gocrawl v0.4)

From reading the closed issue found here: PuerkitoBio/gocrawl#41

The author has said the following: PuerkitoBio/gocrawl#41 (comment)

  1. That package uses the name Googlebot in it's user agent but does not own or have any rights to Google's copyright in using their name!

  2. This repo has been setup to detect fake bots and that user agent will be flagged now and will fail test runner.

  3. The author even suggests for people to use their newer package called fetchbot which doesn't use the name GoogleBot

  4. Most firewall's block this spoofing attack.

Going to remove support for this third-party library as it is creating incorrect results and will not pass.