I'm not sure it's that cut and dry. But I agree there are some viewpoints more likely to be downvoted than others.

I strongly disagree with Graham's view that disagreement is a good reason for downvoting.