Sample size is immaterial unless you clearly can see and evaluate the criteria under which they were chosen. 8000 of 9000 dentists choose Brand X toothpaste means nothing if they asked 100,000 people and found 8,000 willing to say they liked Brand X. By itself the sample size that is indicated may have little to do with the actual test.
I was going to suggest the same thing, that given about 1/5 of people use Bing (why?) then you simply sample 5000 people, select the 1000 or so Bing users...
However, it turns out there is an easier way. Simply select your sample from existing heavy Bing users. Oddly enough, they'll probably prefer Bing.
Re:Challenging the Bing It On Challenge
by mattwallaert on Tuesday October 01, 2013 @07:15PM
(#6479691)
And this is precisely why a 3rd party does our testing: so that these sort of manipulations don't creep in.
(Note: I work for Bing.)
Well fair enough then, I'll take your word for it. As some marketing advice, beyond a certain (very low) level of savvy, people know the only reason statistics are used is because they're manipulated. So, don't use statistics in your ad campaign unless you want everyone above a certain (very low) level of savvy to reflexively believe they're faked, which isn't going to help your product.
Hey did you know that 9 out of 10 marketing execs endorse everything VLM posts on HN? Yeah thats exactly what I'm talking about. Doesn't matter if it true or even if it matters, its just not a good selling strategy.
He's right, but a sample of 1,000 is rigorous compared to most studies used in adverts. Give a product to 50 people and ask if they like it or not. That turns into 97% of people recommend our product!!
Since I live in a country with heavily regulated advertising I'm surprised that there isn't something to cover "sounding sciencey" or "sounding mathy". Certainly if the math is wrong you can get it changed.