News for hackers. Stuff that matters.
Re:Testing Google's New Algorithm: It Really Is Better by shin_lao on Saturday February 26, 2011 @04:13AM (#2265194)
Why didn't the author test with more queries?

This doesn't sound very professional.

Re:Testing Google's New Algorithm: It Really Is Better by freyfogle on Saturday February 26, 2011 @05:33AM (#2265275)
Agree. I've worked on search for about 10 years. One of the most frustrating things is that no matter what your view point you can always find one or two queries to justify it. Individual queries can be a useful debugging tool, but it's no way to try to assess general search quality. That can only be done by looking at user behaviour over a huge sample set (and over time).