News for hackers. Stuff that matters.
Re:The Dunning-Kruger Effect Is Autocorrelation by jakear on Friday April 15, 2022 @08:19AM (#31039339)
Article seems to be saying “DK doesn’t exist because it always exists”. Which is… absurd?

The point of DK is that when you don’t know shit, any non-degenerate self assessment will result in overestimating your ability. In short, “there are more natural numbers above smaller natural numbers than bigger ones”. This doesn’t have to do with psychology, and it’s expected that it appears when evaluating random data. That’s a good thing! It means DK exists even when us pesky humans aren’t involved at all, not that DK doesn’t exist at all.

Re:The Dunning-Kruger Effect Is Autocorrelation by larwent on Friday April 15, 2022 @09:06AM (#31039752)
Seems pretty simple. When we create upper and lower boundaries to some score, people with lower scores have more space to overestimate and those with higher scores more space to underestimate, causing the perceived score to trend towards the mean.

I think there's both a component of numbers and psychology here. If the dispersion in perceived score caused by inaccuracy is wide enough to touch the bounds, it will force a trend towards the mean. This effect is possibly exacerbated by a tendency of perception to stray from "extremes", so subjects with a score near the edges will trend to the mean more strongly as they are unlikely to rate themselves the very best or very worst.

Re:The Dunning-Kruger Effect Is Autocorrelation by ewzimm on Friday April 15, 2022 @09:53AM (#31040245)
This seems pretty simple to correct, so I'm skeptical that nobody has done so yet in these experiments. If true, it's an equally interesting oversight as the Monty Hall problem. The basic premise is that the structure of an experiment will naturally nudge randomness in a particular direction, and we need to adjust for that in the analysis. Everyone who does this type of work should know this.

In a simplified experiment where we give people a 3 question quiz, those who got 2 questions right have one overestimation option, 3, and two underestimation options, 0 and 1. So it's very easy to adjust for autocorrelation by checking if a large group of 2-scorers underestimate more than twice as often as they overestimate. Then we see how their tendencies compare against 1-scorers and how they deviate from naturally overestimating more than twice as often as underestimating.

I haven't reviewed these types of papers, but if nobody made even that basic adjustment in their analysis, how many others have been missed in experiments like this?

Re:The Dunning-Kruger Effect Is Autocorrelation by stevage on Friday April 15, 2022 @10:27AM (#31040643)
It would be possible to rule out that effect in an experiment.
Re:The Dunning-Kruger Effect Is Autocorrelation by 988747 on Friday April 15, 2022 @12:15PM (#31041939)
It can be ruled out, but most scientists (especially in social sciences) suck at statistics, so they don't know how.
Re:The Dunning-Kruger Effect Is Autocorrelation by erikmolin on Friday April 15, 2022 @10:16AM (#31040517)
I share your sentiment that DK being a statistical phenomenon actually makes the effect more interesting. I also, however, think that you are being too semantically liberal when you insist that this proves the effect exists. The DK effect is a _psychological_ effect, with a whole lot of psychological theories around it's causes. If the cause is statistical, the psychological effect can no longer be said to exist.

The stasticial phenomenon exists, surely - but I think it will be very confusing for everyone to re-use the same name.

Re:The Dunning-Kruger Effect Is Autocorrelation by cortesoft on Friday April 15, 2022 @03:38PM (#31044813)
> In short, “there are more natural numbers above smaller natural numbers than bigger ones”

I get what you are trying to say, but this isn’t true… every natural number has the same amount of numbers greater and smaller… an infinite number.

Re:The Dunning-Kruger Effect Is Autocorrelation by jakear on Friday April 15, 2022 @05:30PM (#31046106)
Natural numbers are not the same as integers. They’re strictly positive.

(Now rate your confidence in making that assertion.)

Re:The Dunning-Kruger Effect Is Autocorrelation by cortesoft on Friday April 15, 2022 @08:55PM (#31047921)
Oh right, not sure what I was thinking.

I don’t understand what you are saying about my confidence?

Re:The Dunning-Kruger Effect Is Autocorrelation by jakear on Friday April 15, 2022 @09:14PM (#31048095)
Just a meta-joke attempt regarding Dunning Kruger.
Re:The Dunning-Kruger Effect Is Autocorrelation by cortesoft on Friday April 15, 2022 @09:52PM (#31048411)
Ahhhhh missed it again