I didn't leave a downvote, but that sounds like a horrible policy. You'd get a ton of short comments on the least-valuable (as judged by voters) comments, bloating the comment tree and making it way less readable.