Meanwhile, I think if somebody replies to you with something like that, it's worth investigating regardless of if they're the top answer or not. I'll draw a parallel to Reddit's "What's your favorite album?" threads. If you were to go by comment points alone, you'd think Radiohead's OK Computer was the best album of all time and that NIN took the four spots under that; meanwhile, albums out of the hive mind don't get as many upvotes, even if the commenter is more passionately in love with them.
Similarly, just because a lot of people think one thing on HN doesn't mean that one thing is the best answer. Looking up multiple solutions may take more time, but that leads to learning and growth, which I think should be the point of any community.
You obviously participate in HN a lot. Don't fault the rest of us for only wanting to do it part time.
Sure, it's a noisy signal because scores don't just indicate agreement, but the context usually makes that clear. If a factual claim is up- or downvoted, it usually indicates that people believe the claim is true or false. For analysis or opinion, it may have to more with whether the comment is insightful or thought-provoking.
If somebody refutes you elegantly, then you should look into their refutation regardless of whether or not the refutation has many points.