It's because if you change your mind frequently enough, people stop listening to you or giving your opinion any weight. I'm not saying this is right, or that it occurs as often as is feared, but it is the fear, and it does occur.