You know that you can easily replace pedophiles with most groups in your post, right? Such as for example "jews". The sad part is that there are actually people who think and thought in the past the same thing, but it is a real danger (as history has shown).

I suggest an alternative: how about judging people by the harm that they have committed to others rather than their race, attraction, opinions, etc?