So, they're more "fragile" off the bat, and this is probably neurological in basis. We can provide more support as a society, but there are obvious limits regarding what can be done here.
Second, society is generally bad at recognizing talent and connecting it with the resources that could be used to actualize it. Those resources tend to go to people-pleasers and horse-traders rather than to those who can make the most use of them (who are almost always viewed with suspicion). This is true as much in academia as anywhere else.
Combine the general stupidity of society and the hypersensitivity of the sharpest intellects, and you have a lot of very smart people who get discouraged and bitter, then lose all desire to play.
Is that a belief support by anecdote, or have you seen some study supporting it?
Whether they bear on IQ itself is an open question, but the fundamental concept is that certain mental habits that produce depression also produce focused thinking (which is a necessity for people who want to achieve at high levels).
A common social quirk of smart people, when they're young-- say 5-10, is to come out with a really good retort 5 seconds after it was appropriate and when it's no longer funny (because it requires a conversational "rewind"). This is because they've put a lot of energy and focus into saying the "right" (funny, most socially beneficial) thing instead of going with the flow.