News for hackers. Stuff that matters.
Re:Most Winning A/B Test Results are Illusory [pdf] by ernopp on Monday February 24, 2014 @05:12AM (#7289997)
Full disclosure: I work for Qubit who published this white paper.

Just wanted to add that if you have less than a million users you can A/B test for upper funnel goals, effectively measuring if changes improve engagement. Obviously then you have the problem of working out if the engagement translates into more sales but perhaps you're willing to wait longer to find out if a test that improves engagement leads to more revenue in the long run.

There are no comments on this comment yet.