I can understand that; I think there's also hesitation at that point in any relationship, where both parties are unsure of how much to invest in further social interactions.

One thing I would say though: if you believe that this is an intrinsic trait that others have, rather than something that can be learned, then this belief may hold you back more than you may think.