Re:U.K. Parties Prepare for 2015 by Erasing Web Histories
by vidarh on Tuesday November 19, 2013 @05:19AM
(#6760253)
You suspect wrong: They added a long list of URLs for their news archives to robots.txt:
http://www.computerweekly.com/blogs/public-sector/2013/11/co...
This does not just cause search engines to stop linking to it, but also causes all the main engines to remove it from publicly accessible caches, and causes Internet Archive to remove the pages as well.
I suspect what they mean is that requests for the files send an appropriate HTTP status code (e.g. 410 - Gone). This is standard practice on any website where something is no longer available and is used by search engines to spot dead links.
It's not a request to Google for censorship.