DuckduckGo bot is going unfiltered

Question

DuckduckGo bot is going unfiltered

Abhirup-99 opened this issue 4 years ago · 3 comments

Abhirup-99 commented 4 years ago

Answer 1 · 2020-05-21T16:08:03.000Z

Can you please provide an example of the user agent.

Answer 2 · 2020-05-22T02:48:37.000Z

https://developers.whatismybrowser.com/useragents/explore/software_name/duckduckgo-favicons-bot/

Answer 3 · 2020-05-22T07:59:15.000Z

Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)
Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; http://duckduckgo.com)
Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

All three user agents from the link you provided are detected as bots by crawler detect. Any user agent with the word bot is automatically detected.