News for hackers. Stuff that matters.
Re:Ask HN: What is your one tip about A/B testing you would ... by dairgram on Thursday January 22, 2015 @03:32PM (#8931558)
Before you get too far, try an A/A test. By this, I mean let the A and B choices be identical. You would certainly expect the outcomes to be equal. Right?

I have seen statistically significant differences in outcomes in A/A testing.

A/B testing has value but being sure to A/A test may temper your expectations and/or point at problems in your setup before you get too far.

There are no comments on this comment yet.