Yes, unfortunately true. It gives the other person a signal that says "I feel like you have enough power in this situation that I have to justify this decision to you".

And if they are the type to push people around whenever they are able, you've basically just told them they are going to win this battle, so go ahead.