News for hackers. Stuff that matters.
Re:Google's robots.txt by jonty on Sunday February 23, 2014 @08:03AM (#7285786)
Oh wow, I didn't realise my robots.txt joke had spread!

I added that to the last.fm/robots.txt many years ago (http://www.wired.com/business/2010/08/robot-laws/all/), and have just been made aware that it appears to have spread across the internet:

https://www.google.co.uk/search?safe=off&q="Disallow%3A+%2Fi...

Favourite sites I've found with it so far: php.net, princeton.edu, nest.com, songkick.com.

There are no comments on this comment yet.