News for hackers. Stuff that matters.
Re:Amazon's AI crawler is making my Git server unstable by qwaxys on Sunday January 19, 2025 @04:26AM (#42755435)
Nothing wrong with putting a link to a zip bomb in your robots.txt and disallowing them.

Also, just put a limit on requests per IP? https://nginx.org/en/docs/http/ngx_http_limit_req_module.htm...

Re:Amazon's AI crawler is making my Git server unstable by jdjdjdjdhy on Sunday January 19, 2025 @09:13AM (#42757139)
How would that help you? Bots generally don't care about zip contents