News for hackers. Stuff that matters.
Re:20 lines of code that beat A/B testing (2012) by aidanf on Wednesday April 06, 2016 @04:06AM (#11437373)
Here are 2 good articles that follow up on the arguments presented by VWO in that article.

From the first link below: "They do make a compelling case that A/B testing is superior to one particular not very good bandit algorithm, because that particular algorithm does not take into account statistical significance.

However, there are bandit algorithms that account for statistical significance."

* https://www.chrisstucchio.com/blog/2012/bandit_algorithms_vs...

* https://www.chrisstucchio.com/blog/2015/dont_use_bandits.htm...

Re:20 lines of code that beat A/B testing (2012) by paraschopra on Wednesday April 06, 2016 @04:48AM (#11437518)
Chris is now VWO's director of data science. We recently overhauled our stats. Here's a quick summary for that: https://vwo.com/blog/smartstats-testing-for-truth/
Re:20 lines of code that beat A/B testing (2012) by thenomad on Wednesday April 06, 2016 @05:57AM (#11437756)
Interesting. Lack of Bayesian testing is one of the reasons I've never considered using VWO - nice to see that's now your main methodology.
Re:20 lines of code that beat A/B testing (2012) by mkesper on Wednesday April 06, 2016 @06:55AM (#11437922)
Changing you users UI always bears some cost, though, so I'm not sure it's really the smart choice.