It's like a person brand new to the job - you don't know their skills yet. After a few months one's co-workers should see those skills in action enough that the suspicion disappears. And after a few years the worker will hopefully develop enough that they can demonstrate their competency to pretty much anyone.

And ultimately the person will be enjoying their career, which makes most other considerations irrelevant.

It's not as if outsiders to a job have the ability to accurately evaluate the person doing the job. A company can't be held responsible for someone else's Dunning-Kruger effect.