An A/B test should probably measure user complaints. A complaint is an indicator that a user’s usage pattern may change in the future. Of course, it may not.

Although, as a user I’ve learned to complain by canceling (and explaining why when possible).