That, more than anything.
There's a RadioLab episode about that at http://www.radiolab.org/story/debatable/ An example they use is that if a debater A has six points in his speech that need to be addressed, and the opponent B only addresses four, A wins by default, since there were two points that were unaddressed.
It reminds me a lot about this election, where there's so much polluting the discourse that there's no time to address the substance (and it plays better to the audience, as Moonves stated).
I hate downvote buttons. Programmers seem to put them there only because we demand symmetry. If there's a plus there must also be a minus. I rarely, if ever, see negative votes used to suppress actual spam or obvious trolling ... the only place I've ever seen that actually happen is on Slashdot where the system actually does suppress auto-generated garbage, page-widening posts, etc. Everywhere else people use +/- buttons to indicate disagreement.
Unfortunately, the further left you go, the more you become convinced that people who disagree with you are dumb and easily manipulated. Thus suppressing opinions you disagree with becomes more and more acceptable. Thus downvoting any right-wing thinking into invisibility becomes not just acceptable but important. This trend of course culminates in far-left communist countries where political censorship is an official state policy.
So people with those opinions then rapidly learn that they aren't welcome, that people aren't interested in real debate ... and leave. Forums that could have been debating centers for mutual understanding turn into echo chambers.
The solution is to eliminate downvoting and do what Slashdot does: require you to pick a reason when upvoting, use randomly chosen moderators, and meta-moderate the moderators.
Also the west seem to have lost its debate culture. These days most debates of conservatives and progressives in shouting 'commie' and 'racist' at each other. In a good debate you wanna help your opponent to give the best possible argument for his position and then try to disprove it. Everything else is lazy and not beneficial for anyone.