News for hackers. Stuff that matters.
Re:Most AB-tests will fail by m4xt3r on Wednesday June 19, 2013 @10:35AM (#5905770)
Alright, that was a bold statement on my side. That's true for 99.9% of the companies, not 100%.

Again, most of us don't have enough traffic to make successful buton color tests.

Re:Most AB-tests will fail by justinmarsan on Thursday June 20, 2013 @06:14AM (#5911190)
Have you tried MAB ? It seems like the best way to do A/B testing on small-traffic pages, let it run forever without losing much due to the reduced frequency of poorly performing variantes.

Setup your test with 3 or 4 colors, the programm will automatically pick the best one over time, so it doesn't matter how long you let it run, be it weeks months or years, and when you don't want to test it anymore you pick the one that performed the best out of the many visitors you've had over a large period.

http://en.wikipedia.org/wiki/Multi-armed_bandit

Re:Most AB-tests will fail by mjhea0 on Wednesday June 19, 2013 @10:37AM (#5905781)
thank you!

i cannot tell you how excited i get when a client wants to split only to change a color of a button or a subtle change in a particular font. so frustrating!