Re:Amazon's AI crawler is making my Git server unstable
by xena on Friday January 17, 2025 @04:12PM
(#42743293)
The website that you were pummeling is in the article: git.xeserv.us. I sent an email earlier today and have gotten no response.
Right now your crawler bots are getting the bee movie script, so you may want to delete all the data that's being scraped from that domain. Unless you like jazz that is.
It'd be a gesture of good faith to remunerate me for the egress fees your bot incurred, but I'm not gonna die on that hill.
Right now your crawler bots are getting the bee movie script, so you may want to delete all the data that's being scraped from that domain. Unless you like jazz that is.
It'd be a gesture of good faith to remunerate me for the egress fees your bot incurred, but I'm not gonna die on that hill.