I had a similar problem in school. Kids didn't want to be associated with me because they thought I was gay (even though it turned in my case that I'm not). I think in many cases not because they personally had a problem with being gay, but because they were afraid of becoming a target themselves by association.