Ability to block wildcard user agents.
MrBruz opened this issue · 7 comments
I know this is very obscure but cloudflare keeps trying to "cache" the site which immediately clashes with hellpot (even with robots.txt) so i was wondering if you could add a feature where it ignores certain user agents?
Wait, cloudflare isn't respecting robots.txt? Yikes.
Still, not a bad idea to have a blacklist for user-agents! I'll look into this.
Yeah cloudflare keeps trying to load index.html without actually reading robots.txt first so it kept clogging up the hellpot logs unfortunately.
172.69.79.101 - - [06/Apr/2022:02:22:47 +0000] "GET / HTTP/1.1" 200 3324 "-" "Mozilla/5.0 (compatible; Cloudflare-Traffic-Manager/1.0; +https://www.cloudflare.com/traffic-manager/; pool-id: 8fbe86cafa1408c6)"
I have implemented and tested this in the development branch. Feel free to re-open this if you feel necessary, for now I'm gonna close this :)
One small detail: if you enable trace level logging, one will still have log entries for these blacklisted requests. This is done intentionally so that the user can debug their configuration. Trace logging is disabled by default.
I have implemented and tested this in the development branch. Feel free to re-open this if you feel necessary, for now I'm gonna close this :)
One small detail: if you enable trace level logging, one will still have log entries for these blacklisted requests. This is done intentionally so that the user can debug their configuration. Trace logging is disabled by default.
Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)
Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)
lmao that's hilarious, don't forget to use the limiting features in the config file
that may be an idea for another feature actually, bandwidth counting and auto shutdown based on it or something
Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)
lmao that's hilarious, don't forget to use the limiting features in the config file
that may be an idea for another feature actually, bandwidth counting and auto shutdown based on it or something
Yep it is haha, may I ask what limiting features you were thinking I should enable? Couldn't see anything in the Readme I think.
Although yea that would make for a really good feature, I'm thinking either a cap on how much bandwidth usage per day, or just a simple cap on outgoing speed. 👍
Lines 102 to 105 in 41c6a0a
However, I like the idea of adding more control to that, which I can do. Could you please make a separate issue for this?