News for hackers. Stuff that matters.

A comment on Why Multi-armed Bandit algorithms are superior to A/B testing (with Math). Parent comment

Re:Why Multi-armed Bandit algorithms are superior to A/B tes... by kevinconroy on Sunday June 03, 2012 @11:20AM (#4060928)
Most websites lack sufficient traffic to reach statistical significance in a short time frame. Sure, Google and Facebook can run a test and get real results in a day (or even hour(s)), but the rest of us need weeks or months to do things properly
[ Parent | on HN ]
Re:Why Multi-armed Bandit algorithms are superior to A/B tes... by astrec on Sunday June 03, 2012 @11:54AM (#4061064)
That really depends on the level of significance and the size of the effect you wish to detect.
[ Parent | on HN ]