News for hackers. Stuff that matters.
Re:Challenging the Bing It On Challenge by DanBC on Tuesday October 01, 2013 @12:52PM (#6477354)
> When I looked into the claim a bit more, I was slightly annoyed to learn that the “nearly 2:1” claim is based on a study of just 1,000 participants. To be sure, I’ve often published studies with similarly small datasets, but it’s a little cheeky for Microsoft to base what might be a multi-million dollar advertising campaign on what I’m guessing is a low six-figure study.

He's right, but a sample of 1,000 is rigorous compared to most studies used in adverts. Give a product to 50 people and ask if they like it or not. That turns into 97% of people recommend our product!!

Since I live in a country with heavily regulated advertising I'm surprised that there isn't something to cover "sounding sciencey" or "sounding mathy". Certainly if the math is wrong you can get it changed.

Re:Challenging the Bing It On Challenge by coldcode on Tuesday October 01, 2013 @01:23PM (#6477591)
Sample size is immaterial unless you clearly can see and evaluate the criteria under which they were chosen. 8000 of 9000 dentists choose Brand X toothpaste means nothing if they asked 100,000 people and found 8,000 willing to say they liked Brand X. By itself the sample size that is indicated may have little to do with the actual test.
Re:Challenging the Bing It On Challenge by VLM on Tuesday October 01, 2013 @02:26PM (#6478094)
I was going to suggest the same thing, that given about 1/5 of people use Bing (why?) then you simply sample 5000 people, select the 1000 or so Bing users...

However, it turns out there is an easier way. Simply select your sample from existing heavy Bing users. Oddly enough, they'll probably prefer Bing.

Re:Challenging the Bing It On Challenge by mattwallaert on Tuesday October 01, 2013 @07:15PM (#6479691)
And this is precisely why a 3rd party does our testing: so that these sort of manipulations don't creep in.

(Note: I work for Bing.)

Re:Challenging the Bing It On Challenge by VLM on Wednesday October 02, 2013 @10:37AM (#6482621)
Well fair enough then, I'll take your word for it. As some marketing advice, beyond a certain (very low) level of savvy, people know the only reason statistics are used is because they're manipulated. So, don't use statistics in your ad campaign unless you want everyone above a certain (very low) level of savvy to reflexively believe they're faked, which isn't going to help your product.

Hey did you know that 9 out of 10 marketing execs endorse everything VLM posts on HN? Yeah thats exactly what I'm talking about. Doesn't matter if it true or even if it matters, its just not a good selling strategy.