News for hackers. Stuff that matters.
Re:Optimizely Statistics Engine by thinkmoore on Tuesday January 20, 2015 @12:36PM (#8918103)
What's so particularly embarrassing is that you clearly did not have any competent statisticians on board until now. This was not some big surprise that needed "a lot of resources to fix." This is something that should be obvious to anyone who understands hypothesis testing, and is something that statisticians have been describing how to do correctly for over 50 years: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1551774/
Re:Optimizely Statistics Engine by joecasson on Tuesday January 20, 2015 @12:42PM (#8918158)
By that logic, no one else in the industry (Adobe, Mixpanel, VWO) has competent statisticians. That's silly.
Re:Optimizely Statistics Engine by thinkmoore on Tuesday January 20, 2015 @12:44PM (#8918170)
Apparently that might be the case. I mean the problem with multiple hypothesis testing is not exactly rocket science...
Re:Optimizely Statistics Engine by dargani123 on Tuesday January 20, 2015 @02:01PM (#8918751)
Hey - I combined a response in this link here: https://news.ycombinator.com/item?id=8918746