News for hackers. Stuff that matters.
Re:The (humorous) dangers of Google's new deep search by sdurkin on Thursday April 17, 2008 @03:17AM (#166156)
Very funny anecdote. What bothers me though is that this implies that Google seems to think they own the web.

For example, they told the guy that he was lucky that they were willing to give him a backup, but it seems to me that Google's the one that should be taking responsibility for their actions.

Its a short jump from, "you have to use POST or we'll delete your stuff" to "you have to follow Google standard X or we won't index your site."

Welcome to the first web empire.

Re:The (humorous) dangers of Google's new deep search by Tichy on Thursday April 17, 2008 @07:05AM (#166226)
No, any web crawler would have done the same thing. It is simply an error to modify content with a GET.
Re:The (humorous) dangers of Google's new deep search by meat-eater on Thursday April 17, 2008 @12:37PM (#166474)
I agree. Google simply followed the the semantics of http. They had similar problems with the the Google Web Accelerator before. But it's really hard to blame google for the mistake of other programmers.
Re:The (humorous) dangers of Google's new deep search by TFrancis on Thursday April 17, 2008 @08:52AM (#166262)
Additionally, the interface to web crawlers (robots.txt) is well defined.
Re:The (humorous) dangers of Google's new deep search by sdurkin on Thursday April 17, 2008 @02:45PM (#166604)
Yes, it is an error. What alarms me is Google's attitude.

What happens when we're dealing with interfaces that are a little bit more ill-defined? Will Google continue to demand that you follow their way of doing things?

Google's attitude in this case suggests they will.

Re:The (humorous) dangers of Google's new deep search by neilc on Thursday April 17, 2008 @06:43PM (#166762)
It's not "their way of doing things", it is just the way the web works (per HTTP spec). Any crawler would have done the same thing in that situation -- that fact that it happened to be Google is merely coincidental. Given the scale at which they operate, you can't expect Google or any other web-scale crawler to be mind-readers.
Re:The (humorous) dangers of Google's new deep search by marcus on Thursday April 17, 2008 @11:13AM (#166378)
At least search engines can be told not to touch a certain link, if a bored user did the same thing who would you blame?