Only once or twice. Other people's feelings are for them to own, doesn't bother me. The power asymmetry doesn't change between employer and employees if you don't make efforts to do so. That's more important to me than if you like me as a person, or want to have lunch with me.