I will downvote comments that are simply low quality, like comments that merely say "^ This!". I don't usually downvote bad faith arguing because it's hard to prove when someone is arguing in bad faith versus just simply having bad arguments.

Sometimes the person just misinterprets the conversation, especially if not being a native english speaker, but the responses could get overly harsh and that's a pity because I'd like to see more international discussions here.