Re:ROBOTS.TXT is a suicide note
by Artemis2 on Thursday January 12, 2017 @04:01AM
(#13380867)
On the page: "While the onslaught of some social media hoo-hah will demolish some servers in the modern era, normal single or multi-thread use of a site will not cause trouble, unless there's a server misconfiguration"
Resource Limit Is Reached
The website is temporarily unable to service your request as it exceeded resource limit. Please try again later.
The irony! Cache link:
http://webcache.googleusercontent.com/search?ei=h0J3WMKKA4er...