You may not like the idea of tolerance being necessary, but the truth is that almost everybody is "against" things that they nevertheless don't actively oppose. It's just going to happen for any society where the population exceeds one person. Tolerance as a concept has its problems, but I think it is overall helpful.