Most people's self esteem is dependent on others. That's the pay-off for being a social animal.

If you're highly self confident without any feedback from other people, chances are you're mistaken. Not guaranteed, but highly likely.