News for hackers. Stuff that matters.
Re:Most Winning A/B Test Results are Illusory [pdf] by rubiquity on Sunday February 23, 2014 @05:35PM (#7287957)
Coming from a poker background, where sample size trumps everything, I've LOL'ed at every person that has ever whipped out an A/B test on me.
Re:Most Winning A/B Test Results are Illusory [pdf] by StavrosK on Sunday February 23, 2014 @08:03PM (#7288539)
This doesn't follow. What if their sample size was 100,000 conversions?
Re:Most Winning A/B Test Results are Illusory [pdf] by rubiquity on Sunday February 23, 2014 @08:22PM (#7288596)
Did you even read the article? The third point is "regression to the mean."