News for hackers. Stuff that matters.
Re:Statistical significance & other A/B test pitfalls by btilly on Saturday July 31, 2010 @11:07AM (#1563796)
The problem is that when you're near confidence you're in the tail, and the student t-test is extremely sensitive to the shape of said tail. If n is large enough this difference will be washed away as everything converges to normals. But with smaller sample sizes the difference can be quite significant.

There are no comments on this comment yet.