Radical Candor by Kim Scott speaks directly about this topic in the opening chapters and also the consequences of avoiding the conversation, because it makes you as the manager feel awkward. I highly recommend the book and I find it even better than Difficult Conversations or Crucial Conversations.