Haha, if we are going to use terrible reward function analogies to measure success, why stop at A/B testing? Introduce your features as mutations to your product! Start them off with one or two customers. Those features that make your users quit in a huff will be eliminated. Those that make them recommend your app to a friend will propagate. Survival of the fittest feature!