That's a fundamental tension in the purpose of the site. If the particular problem of the asker is the end goal, then duplicates would not be closed. All other site criteria institute a strong demand for general interest of questions.
Part of its success may be deftly balancing those two conflicting interests. On one hand is the role of helping people, and the other hand is a non-repeating and immediately useful knowledge base. Both of these demands bring human attention, and satisfying either requires real work by a human. The challenge is to keep the relevant human around just long enough to do enough work so that you have plausibly usable content.
Accepted answers are a site design tailored for one use, but it is fantasy to pretend that it harmoniously exists along side the other use. They are not separated. Design elements oriented toward one way of use degrades the other use.
But practically forcing users to select an answer as "good" should probably not be the only way to do this.
I know because I write those kinds of answers.
I wish they would unpin those answers from the top - leave the green checkmark, just let me sort by whatever has the most votes recently - say in the past year. Then we'd get more up-to-date answers more attention, and more readers would find them.
In the common case, the accepted and best answers will probably be the same, so keep the classic green checkmark there.
When the accepted and best answers don't match, have two checkmarks (or whatever) - one that explicitly says "user XXX accepted this answer" and the other that says "this is the best answer".
SO seems to reward "technically correct" fast on the submit / answers compared to more thoughtful answers.
This also is reflected in what gets answered and what does't. If it requires nuance or thought it doesn't get answered.
I asked something like "How would you render a bazillion things in react under X conditions and manage performance?"
The responses were all "show me your code" or "here is how you render them" Like guies no, I know how to just render them... I'm asking about keeping the DOM from going bonkers.
But their responses "work" and so that's all I got.
It's like if you have a health-related question and get answers from two people: A trained surgeon and your mate from the pub (Edit: who's obviously not trained or knowledgeable on the topic, jeez). A priori whose answer is the more insightful?
If you're not knowledgeable and get a number of anonymous answers it may be difficult to get an idea of their relative 'values'.
But put it this way. Trained surgeon A who has 5 years experience and has been on the site for 3 years has 4000 reputation. Answers a question.
A trained surgeon with 26 years experience who joined the site last week and has a reputation of 200 supplies a far better answer with added explanation of why and how etc.
You look at it and say oh wow 4000 reputation he must know more than the other guy. I’ll take his advice over the 200 reputation guy.
If you don't understand how comparisons work, you have a bigger problem to worry about.
> put it this way
The question then becomes... the 26 year veteran surgeon does boob jobs and tummy tucks. The 5 year veteran does emergency room and brain surgery.
Given how complicated something as simple as "surgery" is... how do you plan on registering and ranking something with multiple levels of "experience" for "easy" viewing by users who want to ask questions?
New to site, surgeon, decades of experience, plastic surgery
Been on site, surgeon, years of experience, "real" surgeon
I'm not aware of any discussion forum that has yet come up with an effective way to balance those competing effects. I suspect it would need a more complicated moderation/voting system that grades a comment on multiple scales independently, with credibility/correctness being one of them. But then you have a new problem of how to keep the system manageable so that users can still operate it with negligible effort and without the scoring system becoming confusing and more trouble than it's worth.
1. If you're asking for help on a topic, then--by definition-- you are in an information asymmetric situation. You don't know what the right answer is. There's a decent chance that you, as the asker of the question, are not in a position to evaluate the answer on its merits.
2. Therefore you have to choose the answer based on other factors. On SO you can do something like see if the proposed answer makes sense to you, and check if the answer produces the results you want. Those are pretty okay metrics. But, obviously, they aren't perfect. Whether it makes sense to you doesn't fully track the truth of the situation, and whether it works or not doesn't address whether it's a good idea for other reasons, like being grossly inefficient, or deprecated, or unmaintainable, or whatever. So there's a decent chance that you can't evaluate the answer on its own merits, AND that sensible heuristics will fail you because you don't know what you don't know about the full context of the question, and might choose a wrong answer as a result.
3. Therefore, an additional useful signal you can track is the reputation and apparent expertise of the person who is answering. Of course, exactly as you say, it's not a perfect metric. But I think it's a meaningful signal that is generally useful to consider. Eg. If Jon Skeet answers my C# question, I just have a strong prior that it's correct in a robust way.
It's an empirical question whether removing that signal would somehow improve the overall outcome (eg. removing that signal forces people use only use the heuristics that are based on the question itself instead of short circuiting that process in favor of an easier social signal).
But I would bet that the empirical test would show that including the reputation signal improves outcomes, on the general prior that more information is better than less information.
Edit: One thing that would change my bet: one feature of really high quality answers is that they are often long and made of parts, like they explain what to do, and what to avoid, and have details about why that is. You could track the length and detail of an answer as one of your heuristics for choosing a correct answer. If it turned out that people who have the correct answer were more likely to write answers with that sort of detail if their identity was hidden, AND it turned out that people use that sort of detail to decide if an answer were correct or not, then I could imagine better answers existing on the site overall, and those answers being more consistently upvoted.
How long would you keep it anonymized? most questions don't get almost any traffic at all when they are first asked. They only get exposure over time.
It just seems like a posing proposition because it's so easily circumvented in which case it's not worth the effort at all.
There’s been many cases where a high score user answers, gets a lot of upvotes cos people are like “oh his score is 30k so he must be right” yet the answer is not good or incorrect. And there is a better more correct answer by someone with a Low score who get few votes.
Voting should be unbiased and be based on the answer. Not the person who answered.