This argument is too general. "Majority dislike what you do (even if not illegal) -> can pull out all stops to bring you down" is a very bad principle. Just look at the treatment of gay people in the 50s.

Asshole is also pretty subjective.