News for hackers. Stuff that matters.
Re:20 lines of code that beat A/B testing every time by jleader on Friday June 01, 2012 @09:18PM (#4056623)
But... "better" than the other choices, which are only getting 1/10th the traffic. The amount of traffic sent to a choice should be a function of how good you currently think it is, and how much more data you need to be sufficiently certain about that choice. So choices that have insufficient data should get more traffic, and choices that already have sufficient data to be sure they're worse than some other choice should get very little traffic. How much traffic they should get depends on how certain you are of stationarity (is that a word?).

There are no comments on this comment yet.