monperrus/crawler-user-agents

Issues

• Request for new instances

  #366 opened 4 months ago by petrospap
  1

• Disambiguate http clients from crawlers/bots

  #374 opened 3 months ago by srstsavage
  2

• Consider adding `.mjs` export

  #370 opened 3 months ago by DamianGlowala
  1

• Few Google bots are not considered

  #360 opened 5 months ago by sagrawal31
  1

• Misidentified user-agents as bots

  #361 opened 5 months ago by sagrawal31
  2

• Suggestion: test against false positives

  #350 opened 9 months ago by starius
  2

• port CI to GithubActions

  #342 opened 9 months ago by monperrus
  4

• Add AI agents

  #339 opened a year ago by httpjamesm
  1

• Add WordPress Bot/Crawler

  #334 opened a year ago by petrokrupenia
  2

• I noticed a recent bot which I believe is coming from Tencent but can't find documentation for - Ottabot

  #329 opened a year ago by daviddfm
  1

• Add linespider

  #310 opened a year ago by Almenon
  3

• Add GPTBot

  #319 opened a year ago by arch1v1st
  1

• Please also register this on packagist.org to use it via Composer

  #312 opened 2 years ago by vanushwashere
  5

• Consider add Google-Read-Aloud to the bot list

  #307 opened 2 years ago by ictran
  1

• Add Dynatrace / RuxitSynthetic into the list

  #308 opened 2 years ago by matej-c
  0

• Add Freshping bot

  #291 opened 2 years ago by KaliszAd
  1

• Add a metadata property to reflect general purpose of the UA

  #169 opened 6 years ago by claytonrothschild
  4

• Adding new version of existing bot entry

  #293 opened 2 years ago by jbuote
  1

• Addition suggestion

  #288 opened 3 years ago by stanmertens
  4

• Raw list of user-agents

  #260 opened 3 years ago by mirabellette
  1

• Feature request virustotal

  #281 opened 3 years ago by akuankkan
  2

• Add centurybot9

  #266 opened 3 years ago by thatcher
  1

• Add Pingdom bots

  #279 opened 3 years ago by peterrydetorp
  1

• Automatic npm continuous deployments broken

  #277 opened 4 years ago by JBYoshi
  1

• Ordering by most common

  #90 opened 7 years ago by plbowers
  10

• add a script to generate robots.txt

  #265 opened 5 years ago by monperrus
  0

• Feature-Request: Difference between good and bad bots?

  #171 opened 6 years ago by Daijobou
  3

• Headless browser User agents

  #175 opened 6 years ago by hnhegde
  6

• update version on NPM

  #148 opened 6 years ago by f0rmat1k
  3

• Some missing bot UAs

  #68 opened 6 years ago by cmantas
  3

• JSON syntax issues

  #89 opened 7 years ago by plbowers
  2

• Publish to npm

  #14 opened 7 years ago by Qrysto
  7

• remove ".idea" folder from the published npm repository

  #45 opened 7 years ago by tekool
  2

• Instagram bots details

  #75 opened 7 years ago by GulinSS
  3

• How to Install in Apache?

  #86 opened 7 years ago by PauloBoaventura
  1

• Add links to language specific libraries and alternative databases in the README file

  #76 opened 7 years ago by fallax
  1

• Add pattern for Facebook app prefetching

  #73 opened 7 years ago by fallax
  3

• Some user agents have incorrect capitalisation

  #70 opened 7 years ago by fallax
  5

• New bot names to add

  #67 opened 7 years ago by fallax
  3

• add test code for the validation mechanism

  #63 opened 7 years ago by monperrus
  0

• Problem with AdsBot-Google user agent

  #54 opened 7 years ago by vetyy
  5

• duplicate entries

  #42 opened 8 years ago by jimdigriz
  1

• Voyager crawler

  #35 opened 8 years ago by jpavello
  1

• BingPreview

  #36 opened 8 years ago
  0

• Code-friendly license

  #23 opened 8 years ago by lxg
  3

• Why is "Googlebot" not recognized without trailing slash?

  #22 opened 8 years ago by egilburg
  1

• Escape dots

  #10 opened 9 years ago by Alain-es
  2

• AddThis

  #8 opened 9 years ago by GurneyHallack
  2

• Yandex Browser

  #9 opened 9 years ago by alex-mashin
  1