Re:Ban me at the IP level if you don't like me
by yumraj on Monday August 25, 2025 @03:26AM
(#45011231)
Wouldn't it be better, if there's an easy way, to just feed such bots shit data instead of blocking them. I know it's easier to block and saves compute and bandwidth, but perhaps feeding them shit data at scale would be a much better longer term solution.
[ Parent
| on HN ]
Re:Ban me at the IP level if you don't like me
by sotspecatcle on Monday August 25, 2025 @03:36AM
(#45011290)
if ($http_user_agent ~* "BadBot") {
limit_rate 1k;
default_type application/octet-stream;
proxy_buffering off;
alias /dev/zero;
return 200;
}
Re:Ban me at the IP level if you don't like me
by Avamander on Tuesday August 26, 2025 @08:02AM
(#45025352)
I recommend you use gzip_static and serve a zip-bomb instead. Frees up the connection sooner and probably causes bad crawlers to exhaust their resources.
Re:Ban me at the IP level if you don't like me
by internet_points on Monday August 25, 2025 @03:56AM
(#45011397)
Re:Ban me at the IP level if you don't like me
by throwawayffffas on Monday August 25, 2025 @03:31AM
(#45011266)
No serving shit data costs bandwidth and possibly compute time.
Blocking IPS is much cheaper for the blocker.
Re:Ban me at the IP level if you don't like me
by fuckaj on Monday August 25, 2025 @04:56AM
(#45011761)
Zip bomb?
Re:Ban me at the IP level if you don't like me
by aspenmayer on Monday August 25, 2025 @05:47AM
(#45012067)
Doesn’t that tie up a socket on the server similarly to how a keepalive would on the bot user end?
Re:Ban me at the IP level if you don't like me
by recursive on Monday August 25, 2025 @11:43AM
(#45015110)
I don't think so. The payload size of the bytes on the wire is small. This premise is all dependent on the .zip being crawled synchronously by the same thread/job making the request.
Re:Ban me at the IP level if you don't like me
by aspenmayer on Tuesday August 26, 2025 @09:00AM
(#45025944)
What if bots catch on to zip bombs, and just download them really slowly?
https://en.wikipedia.org/wiki/Zeno%27s_paradoxes#Dichotomy_p...
Re:Ban me at the IP level if you don't like me
by throwawayffffas on Thursday August 28, 2025 @07:37PM
(#45058250)
Their objective is not to DDOS websites, if they catch on, they will download it fast and then discard it.