News for hackers. Stuff that matters.

A comment on A/B testing original design vs. random template bought from ThemeForest. Parent comment

Re:A/B testing original design vs. random template bought fr... by artiscode on Friday March 15, 2019 @08:12AM (#19398921)
Resource provided uses a very naive approach to determining the outcome of an AB test. It's not accurate, given the very small numbers.
[ Parent | on HN ]
Re:A/B testing original design vs. random template bought fr... by bemmu on Friday March 15, 2019 @08:15AM (#19398945)
Yes, I don't have much data to work with, and was also surprised that the calculator considered this significant. But even without significance, I assume it still makes sense to go with the winner?
[ Parent | on HN ]
Re:A/B testing original design vs. random template bought fr... by no_gravity on Friday March 15, 2019 @08:41AM (#19399113)
Does the calculator really use the word "significant"? I don't see it. I am not sure how to interpret the language it uses.

As for going with the winner: Yes, if the test result (39/28) is the only information you have and there are only two choices (go with winner / go with loser) then it makes sense to go with the winner.

[ Parent | on HN ]