News for hackers. Stuff that matters.
Re:Bayesian A/B Testing by kobyszcze on Thursday May 29, 2014 @11:29AM (#7816716)
You could use identical priors for each variant, with the mean equal to the empirical mean of your existing system, and the variance controlling how plausible big improvements are.

In this case your prior mean could be something as simple as an average conversion rate for all your past articles.

Remember that by using frequentist statistics your are implicitly assuming a uniform prior---I think it's quite easy to find weakly informative priors which are more plausible than saying that any conversion rate is equally likely.

Re:Bayesian A/B Testing by yummyfajitas on Thursday May 29, 2014 @11:42AM (#7816788)
Or even better, you can look at the conversion rates of past articles and fit a beta distribution to them.