News for hackers. Stuff that matters.

Planning and Running Effective A/B Tests

When it comes to A/B testing, everything boils down to reducing guesswork and making decisions based on hard data

Read more about best practices that should bring results to your e-commerce business:

http://bit.ly/ABTesting_article

( 5 comments | 2 points | on HN )
Re:Planning and Running Effective A/B Tests by karol_kielecki on Thursday January 23, 2020 @10:37AM (#22128337)
Re:Planning and Running Effective A/B Tests by ellinoora on Thursday January 23, 2020 @11:00AM (#22128547)
There's quite a few problems in traditional A/B testing. See here for example: https://volument.com/learn/problems-in-traditional-ab-testin...
Re:Planning and Running Effective A/B Tests by karol_kielecki on Friday January 24, 2020 @06:48AM (#22137273)
I agree with some points, especially with the time frame. Sometimes traditional A/B tests take too long. Global design changes, new product launches, brand refreshing, or new information architecture are more important.

On the other hand, doing A/B tests for small changes can also have a significant impact on your overall results. I think doing A/B tests is better than not doing them at all.

Re:Planning and Running Effective A/B Tests by grzm on Thursday January 23, 2020 @10:39AM (#22128360)
Please don't use url shorteners as it obscures the destination URL. Also, preferred practice is to just some the URL as a normal submission. If you have something to add, do it in a comment on the submission.
Re:Planning and Running Effective A/B Tests by karol_kielecki on Friday January 24, 2020 @04:46AM (#22136742)
Thanks for the suggestion! I'll keep in mind that next time.