News for hackers. Stuff that matters.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @12:26AM (#31118211)
> I think Dunning Krueger makes intuitive sense.

It’s been argued before that this is the only reason that DK gained any notoriety; because it feels right, not because it is right. It’s the “just-world” theory: we want to believe that confident people are overcompensating.

Is it actually intuitive though? Consider your own example. Most people who don’t know piano or figure skating are well aware that they don’t know, and do not rate themselves highly at all. Would it be surprising to learn that people who don’t know any law or engineering don’t often hold any doubts about their lack of skill, and by and large are not deluded nor erroneously believe they’re great at these things they don’t know?

The DK paper didn’t measure knowledge-based skills like piano, figure skating, or law. It measured things like the ability to get a joke, and conversational grammar. How would you rate your own ability to get a joke? (Does this question really even make a lot of sense?)

It’s important that the methods in the DK paper focused on tasks that are hard to self-evaluate, because when people have tried to replicate DK with more well defined knowledge-based activities, they have often demonstrated the complete opposite effect, that there is widespread impostor syndrome, and skilled people underestimate themselves.

Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by audiometry on Friday April 22, 2022 @04:02AM (#31119317)
"Most people who don’t know piano or figure skating are well aware that they don’t know, and do not rate themselves highly at all. "

I think this case (real_skill = 0, perceived_skill = 0) is maybe a trivial case, and that the bit of truth DK-idea catches is when someone with very little skill considers how much work it would be to get to whatever a 'fully skilled' version would be, they woefully underestimate.

Picture someone in their first summer of mountain biking watching youtube videos of the best guys. Yes, you know you can't jump like they do, or turn as skillfully, but you're getting better each month. However, you still grossly underestimate how hard it is to get to that skill level.

At least it's my personal experience as a thoroughly unskilled!

Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by sn41 on Friday April 22, 2022 @02:20AM (#31118802)
> It’s been argued before that this is the only reason that DK gained any notoriety

I'm sorry, but I have to comment on a word in this line: I feel that increasingly, "notoriety" is used when "notability" might be better.

A thief is notorious. A statistical effect is notable, imho.

But I agree with your basic point: I can't skate, much less figure skate. And I am pretty accurately aware of that fact despite my lack of skill.

Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @10:24AM (#31121927)
Notoriety means “the state of being famous”, which is the meaning that I intended. I actually don’t want to use “notable” in this case, because that would imply that I believe the DK effect is real. Notorious might even be a good word here, since the paper has problems with its claims and its interpretation of it’s own data.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by hef19898 on Friday April 22, 2022 @03:13AM (#31119101)
>> figure skating, or law

Thinking about all the "INAL" answers and the obviously wrong "legal" advice and opinion on legal topics you can come across on HN on a daily basis, I think law is good example of people overestimating their knowledge.

Replace figure skating with any other sports, so, and try having discussions about, e.g, a defeat of any soccer team. All of a sudden everyone just became a soccer coach. And everyone is able to critique individual player's performance and skill and technique. If anything, this proofs the DK effect rather well.

Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @10:21AM (#31121893)
You might be forgetting that DK demonstrates a positive correlation between confidence and skill. They gave statistical evidence for people who believe they’re right actually being right more often on average. The question the paper is actually asking is why aren’t people’s self-estimates perfect, but it does not, contrary to popular misunderstanding, demonstrate that confident people are lower skilled. Reading bad legal advice on HN is not a demonstration of the so-called DK effect.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by sally_glance on Friday April 22, 2022 @03:44AM (#31119248)
But is DK not explicitly about assessing yourself and not about assessing others? I feel like being able to critique the performance of others is different from being able to critique yourself. There might be a correlation between the two, but they're not the same.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @09:57AM (#31121584)
The DK paper is not about assessing one’s self. There was a self-eval, but the primary methodology used for most of the data & conclusions was to rank one’s self against the others in the group! You are spot on -- this ranking is a major problem for the credibility of the paper’s narrative. Being unable to rank against others precisely, especially when you don’t know their skill level, does not demonstrate that someone is unaware of their own lack of skill.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by hef19898 on Friday April 22, 2022 @04:41AM (#31119467)
Thinking that you are better than the actual pros is the easiest to spot indicator of lacking self assessment, so.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @10:33AM (#31122051)
DK did not measure any actual professionals.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by whiddershins on Friday April 22, 2022 @05:53AM (#31119835)
Thinking you know enough to critique others is a self-evaluation.
Re:I can't let go of “The Dunning-Kruger Effect is Autocorre... by dahart on Friday April 22, 2022 @10:33AM (#31122049)
DK did not measure whether people think they know enough to critique others.