News for hackers. Stuff that matters.

A comment on Ban me at the IP level if you don't like me. Parent comment

Re:Ban me at the IP level if you don't like me by brianwawok on Monday August 25, 2025 @11:15AM (#45014774)
I doubt that’s on purpose. The bad guys that don’t follow robots don’t bother downloading it.

Never assume malice what can be attributed to incompetence.

[ Parent | on HN ]
Re:Ban me at the IP level if you don't like me by cyanydeez on Monday August 25, 2025 @08:19PM (#45020789)
Its likely just a shitty attempt to rate limit bots
[ Parent | on HN ]
Re:Ban me at the IP level if you don't like me by aequitas on Tuesday August 26, 2025 @04:16AM (#45023736)
Bad guys might download the robots.txt to find out the stuff they don't want them to crawl.
[ Parent | on HN ]