That's for comments. AFAIK, there is never a downvote button for stories. I think the standards are different for comments and stories. Flagging a comment should be for something kind of abusive, but flagging a story could be just because it doesn't fit here or because it is the zillionth story on the same topic.