News for hackers. Stuff that matters.
Re:Bing smacks Google in new usability test by nostrademons on Thursday February 10, 2011 @07:39PM (#2204608)
There's another possible source of selection bias: users may be going to Google for queries that they know are a hard, because they assume that Bing won't have the answer. Of course such queries will fail more often, because they're hard.

Bing's marketing has centered around the head of the query distribution - common tasks where definite answers exist, like how to book a flight. It makes sense that such tasks would succeed much more often than long-tail ones like looking up an obscure error message.

Re:Bing smacks Google in new usability test by notahacker on Friday February 11, 2011 @08:02AM (#2206152)
A third possible source would be bias in user samples:

If Bing users are on average less sophisticated (plausible given the assumption that less sophisticated users tend to use IE with the default search engine) they are more likely to click through irrespective of search results' relevance or the potential to improve a query.

What does the "success rate" of AOL's Google-powered search look like?

Re:Bing smacks Google in new usability test by barista on Thursday February 10, 2011 @09:12PM (#2204862)
Well if they are "going" to Google for hard queries then wouldn't they try the queries on Bing first?

Or are you saying that people spend time deciding a query is simple or hard and then choose appropriate search engine for that?

Re:Bing smacks Google in new usability test by nostrademons on Thursday February 10, 2011 @09:20PM (#2204876)
More that they have certain problem domains where they might pick a given search engine, and that those problem domains are biased toward using Bing for easy searches and Google for hard ones.

I'll frequently search for airplane tickets on Bing, for example, while I won't even go to Google for that. But when it comes to looking up obscure programming stuff, I'm not going to bother searching on Bing, I know it'll suck.

Re:Bing smacks Google in new usability test by jamesbritt on Friday February 11, 2011 @01:19AM (#2205393)
"More that they have certain problem domains where they might pick a given search engine, and that those problem domains are biased toward using Bing for easy searches and Google for hard ones."

That makes no sense. Why would you, or anyone, alternate with search engines if one of them too often fails to deliver? Why not just use Google all the time and avoid the cognitive overhead?

Does Google do a poor job, or a worse than Bing job, with airplane tickets?

Re:Bing smacks Google in new usability test by rue on Friday February 11, 2011 @07:17AM (#2206042)
I use DDG except for local sites, which it doesn't index anywhere near as well as Unca Googs.
Re:Bing smacks Google in new usability test by amalcon on Thursday February 10, 2011 @09:16PM (#2204870)
They might try the query on Bing, fail, and then try the same query on Google. A large portion of those are likely to fail as well, just because the queries are hard.

It's less likely that someone will try a query on Google, fail, and then think "Maybe Bing will do a better job with this."

Re:Bing smacks Google in new usability test by barista on Thursday February 10, 2011 @09:23PM (#2204886)
Well in that case wouldn't bing's percentage of failed searches be even larger than Google's? The stats don't reflect that
Re:Bing smacks Google in new usability test by amalcon on Thursday February 10, 2011 @09:33PM (#2204910)
It would cause Google to have a relatively larger proportion of "difficult" searches. Many "difficult" searches on Bing will be repeated on Google, but not the reverse.

If you assume that all "difficult" searches fail on both engines as a first approximation, that would mean that Google will fail all the "difficult" searches, while Bing will only fail the "difficult" searches made by people who primarily use Bing.