News for hackers. Stuff that matters.
Re:Most AB-tests will fail by Felix21 on Wednesday June 19, 2013 @10:07AM (#5905583)
If all you test is the layout then, for the most part, you are Right! Right! Right!

But...

Even with little traffic, you can still achieve significant gains by focusing on the copy as opposed to the layout and colours.

I learnt this mostly with Adwords. At the prices they charge now, you just have to find the gains wherever they are.

Re:Most AB-tests will fail by m4xt3r on Wednesday June 19, 2013 @10:27AM (#5905712)
Same principle applies to copy, especially to microcopy. If you change a couple of words in a headline, it rarely makes a difference.
Re:Most AB-tests will fail by btilly on Wednesday June 19, 2013 @11:15AM (#5906000)
Depends where the copy is. Changing a couple of words in an email subject line can and often does make a huge difference. Of course the fine line you walk is that some of the most effective words at driving behavior (Free! Now!) are also effective at getting you marked as spam.
Re:Most AB-tests will fail by m4xt3r on Wednesday June 19, 2013 @11:27AM (#5906065)
I think wording in the subject line is important, because it is the only thing a user sees. There are no other factors that affect whether he will open it or not.