Growing up I was in 3 different 'gifted' classes, one for each level of school before high school (elementary, middle, junior). There was definitely a bit of a stigma involved -- against us by the people not in the gifted class, and within the class against whoever was deemed not as smart as the majority of the class. Nothing horribly damaging, but definitely present.