News for hackers. Stuff that matters.
Re:Amazon's AI crawler is making my Git server unstable by jdjdjdjdhy on Sunday January 19, 2025 @09:15AM (#42757164)
Self hosting a public git is as cheap as it can get, since it's completely static content

Sure you might get bandwidth saturated, but that can happen with any type of content

Re:Amazon's AI crawler is making my Git server unstable by evantbyrne on Sunday January 19, 2025 @10:23AM (#42757764)
It's a lot less bandwidth to serve one login screen than the entire contents of all of your source repositories to a bunch of crawlers. You can also cache that one login screen in memory.