Going even further off-topic, the sheer speed of Google's updates is one reason why I have felt that the pain-point of "real-time search" is overrated.

There's a difference between searching for a unique phrase (the document is the only exemplar, therefore it ranks #1) and searching for the best page on a breaking topic.

That said, it's not clear to me that humanity actually needs real-time search. Maybe there's some advertising value in winning the race to be #1 for "hudson plane crash" but is there really a business here?

If you were able to sort the results by "last updated" then I might agree, but AFAIK you can't.

With Twitter Search you can easily see the most recent results first.

You can sort by date in a google search. Click on "Show Options" just below the search field, and about 15 lines down in the left bar, "Sorted By Date."

I think it's a fairly recent feature, but it's there.

Damn.

That the hackerne.ws domain is what gets indexed is so fucking ridiculous:

  1) Some cretin camped on a domain and didn't have the courtesy to do a 301
  2) PG is an asshole and ignores the Host header. HTTP/1.1 was a decade ago!
  3) Google is a jackass and prefers a low-pagerank domain.
     Maybe some asshat used Feedburner to proxy RSS via that domain?

That domain is no longer the one indexed. It knows.