When you review feedback collected (in any situation analogous to what you mention), you take that into account.

What if the feedback also said the doctor wasn't personable? Maybe the doc could be a bit warmer with his patients... and a patient would be absolutely qualified in determining whether or not that bedside manner is present.