If keeping down votes I like the idea of at least a minimum reply character length - those could then be added and act as comments.