News for hackers. Stuff that matters.
Re:Winning A/B results were not translating into improved us... by pdpi on Monday September 29, 2014 @11:04AM (#8383176)
Except, apparently, they aren't actually that good at _that_. If an A/A test to not yield 100% chance of 18% uplift, what gives you any degree of certainty that other tests won't have equally skewed results?
Re:Winning A/B results were not translating into improved us... by vitamen on Monday September 29, 2014 @02:58PM (#8384549)
Run an A/A/B (or A/A/B/B) test, decide on traffic levels before you start the test, and let it run until you reach those levels before you peek.