That's not just stereotype threat - to give an example, there are people I know in their early 20s who were strongly discouraged from doing higher level maths in high school, and as a result, had a much harder university level maths experience.