Re:The joys and sorrows of maintaining a personal website
by idoubtit on Saturday May 07, 2022 @04:18AM
(#31292971)
The technical solution is to apply a rate limit on your web server. Then Google bots will receive a HTTP status code 429 "too many requests" that will force them to slow down.
Nginx has `limit_req_zone` that allows fine-tuning the rate limits.
Nginx has `limit_req_zone` that allows fine-tuning the rate limits.