Website unresponsive: diagnostic steps and blocking the AI crawlers Posted by physicsgraph on Thursday December 04, 2025 @06:43AM from the physicsderivationgraph.blogspot.com dept. https://physicsderivationgraph.blogspot.com/2025/12/website-unresponsive-diagnostic-steps.html ( 2 comments | on HN )
Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?