Imagine you get in your car, and suddenly the buttons to roll your windows down are moved to another place. Then they go back.

Nobody would think this is alright.

Besides, I'm advocating for _non explicit_ A/B testing. Let the people know you are fucking with them at least.