Re:Amazon's AI crawler is making my Git server unstable
by evantbyrne on Sunday January 19, 2025 @10:23AM
(#42757764)
It's a lot less bandwidth to serve one login screen than the entire contents of all of your source repositories to a bunch of crawlers. You can also cache that one login screen in memory.
Sure you might get bandwidth saturated, but that can happen with any type of content