All SO tags I've ever followed the number of people answering is greater than the people asking, so that's not really an issue, I think. Although, maybe, it felt that way due to down voting.

The case you described is easy to identify and you can just leave a comment, which will be useful to both: other people answering questions and the person asking. Different from the down vote.