A controversial comment does in fact command a higher burden of proof. Thus the comment has to be of even higher quality. And when it is, I feel it survives the downvotes.

At least I've generally been able to go against the group think and survive downvotes. But generally you need a clear argument, have a real point, and not show bias.

Now, it won't always fly, but I think high quality controversial comments can.