Optimizely to be acquired by Episerver

Re:Optimizely to be acquired by Episerver by martingoodson on Thursday September 03, 2020 @01:44PM (#24366564)

In 2014 I wrote an article on why Optimizely's approach to AB testing was statistically flawed [1]. I was working at a competitor so I needed to be a bit circumspect.

It was discussed here: https://news.ycombinator.com/item?id=7287665

I always wondered how they got away with it for so long.

[1] http://www.datascienceassn.org/sites/default/files/Most%20Wi...

[ Parent | on HN ]

Re:Optimizely to be acquired by Episerver by glangdale on Thursday September 03, 2020 @07:41PM (#24370109)

It's a bit breathtaking how basic the statistics knowledge is to make this critique (not complaining about the critique, mind you). I'm startled that this was coming as news to anyone.

[ Parent | on HN ]

Re:Optimizely to be acquired by Episerver by dr_dshiv on Thursday September 03, 2020 @02:14PM (#24366931)

Have you ever given thought to generalizability in A/B tests? I'm surprised there isn't more of a developing science of constructs that generally work...

[ Parent | on HN ]

Re:Optimizely to be acquired by Episerver by richardFINEman on Thursday September 03, 2020 @06:23PM (#24369572)

Optimizely switched to a Frequentist statistics model in 2015, which changed how pretty much all testing companies do stats. Your article was valid, for a full year.

[ Parent | on HN ]