I think the bigger problem is that A/B only measures certain things and following it blindly can have you descending in important ways that are hard to measure.