Please add majestic to the list of bots/search_engines
nigelhorne opened this issue · 0 comments
nigelhorne commented
See http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
Here's an example from my access.log:
192.99.144.89 - - [27/Aug/2014:02:18:21 -0700] "GET /webmail HTTP/1.0" 404 1078 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)"