Re:A/B testing gets misused to juice metrics in the short term
by saagarjha on Tuesday July 12, 2022 @06:02PM
(#32076261)
> Because it means you just assume you know what their experience is like, or worse: you don't even care about it and bother to learn something.
A/B tests are not the only, or even the best, way of collecting user feedback.
You just described doing business in todays world.
Being a bit more generous towards A/B testing, I would make a counter point: _not_ doing any kind of user testing, of which large scale automated A/B tests are just a subset, means you don't respect your users. Because it means you just assume you know what their experience is like, or worse: you don't even care about it and bother to learn something.
Your complaint seems to be more about the scale and aspect of automation honestly, and continuity of the services, which is a valid complaint against Google but not about A/B testing in general.