> Bryn Mawr is a womens' school and admits only women. However, gender is not always fixed going through life.

Technically true of course, but >99% of the population will identify with a single gender throughout their life. The correlation is so strong that it's not even really a correlation anymore.

If you're going with a probabilistic argument, I think BYU students are more likely to stick with mormonism (let alone Christianity) than Bryn Mawr students with their gender.

That doesn't mean you aren't stereotyping people, though.

Irrespective of the AI discussion (computers don't care if you're stereotyping or not), I really don't think it's stereotyping to assume someone who went to a school which literally only admits women is probably a woman. There's a difference between assuming someone's gender because they're a cheerleader, and assuming because they won the women's cheerleading championship. I also assume that the person who drives a fire truck is a fire fighter.

Right, but the fact the associations are only correlations won't stop the ML model from learning them, if they're present in the training data.

If the training data shows a history of bias against Howard graduates, the model will learn to replicate.