Ability to block wildcard user agents. about hellpot HOT 7 CLOSED

Wait, cloudflare isn't respecting robots.txt? Yikes.

Still, not a bad idea to have a blacklist for user-agents! I'll look into this.

from hellpot.

I have implemented and tested this in the development branch. Feel free to re-open this if you feel necessary, for now I'm gonna close this :)

One small detail: if you enable trace level logging, one will still have log entries for these blacklisted requests. This is done intentionally so that the user can debug their configuration. Trace logging is disabled by default.

Relevant commit here

Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)

from hellpot.

Yeah cloudflare keeps trying to load index.html without actually reading robots.txt first so it kept clogging up the hellpot logs unfortunately.

172.69.79.101 - - [06/Apr/2022:02:22:47 +0000] "GET / HTTP/1.1" 200 3324 "-" "Mozilla/5.0 (compatible; Cloudflare-Traffic-Manager/1.0; +https://www.cloudflare.com/traffic-manager/; pool-id: 8fbe86cafa1408c6)"

from hellpot.

I have implemented and tested this in the development branch. Feel free to re-open this if you feel necessary, for now I'm gonna close this :)

One small detail: if you enable trace level logging, one will still have log entries for these blacklisted requests. This is done intentionally so that the user can debug their configuration. Trace logging is disabled by default.

Relevant commit here

from hellpot.

Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)

lmao that's hilarious, don't forget to use the limiting features in the config file

that may be an idea for another feature actually, bandwidth counting and auto shutdown based on it or something

from hellpot.

Thank you very much, I'll give it a shot when my VPS bandwidth renews (hellpot was using 100gbs/1tb per day)

lmao that's hilarious, don't forget to use the limiting features in the config file

that may be an idea for another feature actually, bandwidth counting and auto shutdown based on it or something

Yep it is haha, may I ask what limiting features you were thinking I should enable? Couldn't see anything in the Readme I think.

Although yea that would make for a really good feature, I'm thinking either a cap on how much bandwidth usage per day, or just a simple cap on outgoing speed. 👍

from hellpot.

However, I like the idea of adding more control to that, which I can do. Could you please make a separate issue for this?

from hellpot.