I think that the reason so many people find this implication palatable is that there are loads of examples of people saying, from experience, that it does in fact happen this way.

The idea is not that they're 'fundamentally' more sensitive or insecure; it's that they're _empirically_ more sensitive and insecure, due to the circumstances of reality.