A/B testing gets misused to juice metrics in the short term

Re:A/B testing gets misused to juice metrics in the short term by adrr on Tuesday July 12, 2022 @12:57PM (#32072742)

We AB tested a performance enhancement to our frontend web app to show that speed had significant benefits to the business. we use the results justify the investment cost. We spent the next six months working on making the site faster because of it. It is a tool. How would you measure things without ab testing?

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by fisf on Tuesday July 12, 2022 @01:34PM (#32073265)

The fact that you need an A/B test to demonstrate that frontend performance has an impact (on user experience first and foremost) in 2022 speaks volumes.

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by ajmurmann on Tuesday July 12, 2022 @03:07PM (#32074369)

But how big is the impact and does that return compare to that of other investments you aren't making because you are improving performance instead?

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by jklinger410 on Tuesday July 12, 2022 @02:07PM (#32073656)

Yet it says nothing. Large companies are slow and stubborn.

[ Parent | on HN ]

Re:A/B testing gets misused to juice metrics in the short term by cupofpython on Tuesday July 12, 2022 @02:58PM (#32074268)

this is the stance I take on AB tests. The are objectively good at things you shouldnt need objective evidence for

[ Parent | on HN ]