People do take a lot of cues from facial expressions and at least in "the West" we rarely wear face coverings. So there's definitely some (mild?) cost to wearing the mask, too.
I will say this, though -- organizations that insist on compelling others to wear masks outdoors are terribly misguided.
Which organizations might those be? State and local governments?
At least in the US, there are more than 50 states/territories, hundreds of cities and more than 3,000 counties. Each of which has separate authority for public health issues.
That said, many (perhaps most?) of those entities have been following the CDC guidelines. Those have now changed. As such. it seems likely that many of those 3,000+ entities will change their policy prescriptions.
No, thankfully I think they're probably making mostly good recommendations there. I'm thinking of stuff like outdoor soccer - parents are asked to wear masks in a big open field with no crowds.
If someone wants to continue wearing a mask for a reason with no harmful externalities (e.g. allergies, privacy), respect their personal freedoms and let them.