Maybe this is naive, but there's something about a binary voting system that just strikes me as something that doesn't fit into a conversation. I often find myself agreeing with certain parts of a comment and not other parts of it. Maybe if the user could vote up the parts of a comment he likes and vote down the parts that he doesn't. Technically, that would be difficult (especially since on HN a comment is simply a text field).