No, the problem with it is that the people who often like to use Statistics in this way use it selectively. If you want to argue that, I can easily argue that Trump supporters and conservatives are far more likely to be racist. Curiously, those same people will dispute that.

Additionally, stats are subject to bias, and can be manipulated very easily to scare people.

Regardless, it's moronic to just assume someone is bad or evil, and really reflects more on you as a person.