Facial recognition may not work reliably if there is training data bias, which can be disadvantageous if you want it to work.

And as you note it can also be used for reducing privacy at scale in a way that humans can't normally do on their own, for example personally identifying thousands of people in a crowd at a sporting event or political rally.