News for hackers. Stuff that matters.

A comment on A/B testing gets misused to juice metrics in the short term. Parent comment

Re:A/B testing gets misused to juice metrics in the short term by Saturdays on Tuesday July 12, 2022 @09:18AM (#32069474)
That's a very weak blanket statement, there are totally reasonable A/B tests you can run that don't deteriorate a user's experience, and the results can guide you to a better customer experience overall.
[ Parent | on HN ]
Re:A/B testing gets misused to juice metrics in the short term by Kaotique on Tuesday July 12, 2022 @10:53AM (#32070868)
It did not mean it too seriously, of course there are also good AB tests, but there are a lot of bad ones out there. Those are what the article was about.

(edited for clarification)

[ Parent | on HN ]
Re:A/B testing gets misused to juice metrics in the short term by HelloNurse on Wednesday July 13, 2022 @05:34AM (#32080543)
Obviously, it depends on what the A/B test is about. Molesting or not the customer for the sake of some shortsighted metric is a bad choice; deciding what content should go above the fold or not (e.g. Amazon places images, short description, details/specs and similar products in that order) is a good choice.
[ Parent | on HN ]