News for hackers. Stuff that matters.
Re:Appsumo reveals its A/B testing secret: only 1 out of 8 t... by wccrawford on Tuesday February 15, 2011 @06:34AM (#2220870)
Every test produces results. Only 1 in 8 produce positive results.

Knowing that 2 different approaches are approximately the same is a great help in design... It eliminates that 'Which way is better?' worry and lets you design it the way that looks best, instead.

Re:Appsumo reveals its A/B testing secret: only 1 out of 8 t... by paraschopra on Tuesday February 15, 2011 @06:39AM (#2220877)
Yep, it is true that even insignificant results can help you concentrating on how to make it look better. But insignificant results are disappointment if your goal is to increase conversion rate.