This project deny crawlers hosting at cloud computing to access nginx servers
- Amazon Aws
- Azure
- Google Cloud
- Digital Ocean
- UKSERVERS-AS UK Dedicated Servers, Hosting and Co-Location
$ sudo mkdir /etc/nginx/blacklist
$ cd /etc/nginx/blacklist
Put this code in nginx.conf
include /etc/nginx/blacklist/*.conf;
$ sudo service nginx reload
https://suip.biz/?act=ipintpr
https://members.ip-api.com
https://ipinfo.io
https://ipgeolocation.io/
https://www.maxmind.com/en/geoip-demo
https://suip.biz/?act=ipcountry
Using converter.rb to convert the list to nginx deny conf
$ bundle install
$ ruby converter.rb list-range.txt
uniq -c ip.txt | awk '{print "deny "$2";"}' > nginx-servemania-range.conf
tail -f access.log | uniq -c | awk '{print " "$3"; # "$2" "$10}' | grep nfce
cat access.log | cut -d' ' -f2 | sort | uniq -c