Alternatively, you could let people downvote as much as they want but cap the karma hit at -10.
Comment posts do have the flag, but only if you look at the comment on its own page, e.g., your comment: http://news.ycombinator.com/item?id=234897
Why not just limit it to -5? There's already the flag for spam and trolls. Just add that to comments as well as posts.