News for hackers. Stuff that matters.
Re:How to increase signups by 50% using “popup forms” by mileszs on Tuesday March 15, 2011 @09:24AM (#2327321)
It sounds like you think that the reported results of these A/B tests are snake oil, not A/B testing itself. I think most authors of A/B-testing-report articles would recommend testing such changes yourself, as opposed to accepting their findings as fact for every site in existence. Those who said the popup forms did not work for them only know that because they A/B tested them.

I think a healthy conclusion is "this worked for us, so it might be a good idea, but you should test it for your site". Wouldn't you agree?

Re:How to increase signups by 50% using “popup forms” by Tichy on Tuesday March 15, 2011 @09:50AM (#2327408)
Yes and no - you can not test it all, there might be a point of diminishing returns after a certain level of optimization that has gone into a site. Just as with SEO - SEO is not completely useless, yet there are people who promise too much or even hurt you.

I suspect with A/B tests you could also hurt yourself, for example if you measure the wrong thing.

I don't know, maybe I am just a little bit tired of all the simplified promises.