It may not necessarily be an innate issue with their social intelligence, but more so a learned reaction. Getting singled out by something as important as speech as a child could have lasting ramifications. Having to constantly weigh your words in stressful social situations sounds like a surefire way to develop social anxiety.