Re:Winning A/B results were not translating into improved us...
by dsugarman on Monday September 29, 2014 @10:56AM
(#8383121)
this is all fine and good, but if you're goal is to see what works best between X new versions of a page and you are rigorous in creating variants, Optimizely is a great tool for figuring out the best converting variant.
[ Parent
| on HN ]
Re:Winning A/B results were not translating into improved us...
by pdpi on Monday September 29, 2014 @11:04AM
(#8383176)
Except, apparently, they aren't actually that good at _that_. If an A/A test to not yield 100% chance of 18% uplift, what gives you any degree of certainty that other tests won't have equally skewed results?