Classic and contemporary psychology experiments replicated

Re:Classic and contemporary psychology experiments replicated by iandanforth on Wednesday November 21, 2018 @11:37AM (#18503868)

"It was surprising that even with these efforts we were only able to obtain support for the original findings for half of the studies. These results do not definitively mean that the original findings were wrong, but they do suggest that they are not as robust as might have been assumed." - Michelangelo Vianello, one of the project leads.

Yes, yes they do. It's ok to say the original findings were wrong. It's ok to re-assert the null hypothesis. The unwillingness to do so undermines the process and is disconcerting to say the least.

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by tlb on Wednesday November 21, 2018 @12:20PM (#18504268)

Failure to replicate doesn't prove the original findings were wrong. Other things that can cause replication failure are:

- Poor explanation of experimental procedure, so the replication doesn't match the original experiment.

- Awareness of the effect may invalidate it. For example, it'd be hard to replicate the Stanford Prison Experiment because every psychology undergrad has heard the story.

- Change in social conditions or prevailing attitudes. Consumer behavior (the subject of some of these studies) has changed significantly over the decades. Homophobia (another study) varies dramatically over time and place.

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by iandanforth on Wednesday November 21, 2018 @12:34PM (#18504391)

We should continue this argument over coffee, hope you're doing well!

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by skrebbel on Wednesday November 21, 2018 @01:02PM (#18504645)

Please record the audio, i'm curious who convinces who.

(or just continue here on HN of course)

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by pfortuny on Wednesday November 21, 2018 @12:39PM (#18504434)

Not exactly: it is ok to say that there were no original findings. This is a tiny semantic detail but important: if the author does not support his findings, it is OK to re-assert the null hypothesis but not to say that "the findings were wrong".

What I mean is: "no experiment" does not mean the same as "wrong experiment".

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by iandanforth on Wednesday November 21, 2018 @12:51PM (#18504527)

Well, let's agree that 'wrong' doesn't mean 'bad.' I use the term in the Feynman sense, if your guess doesn't agree with experiment, it's wrong. The assertion that they found a statistically significant effect was wrong (or to Trevor's point in a sibling comment, is no longer true.)

[ Parent | on HN ]

Re:Classic and contemporary psychology experiments replicated by blbviviv on Wednesday November 21, 2018 @04:21PM (#18506210)

They are saying that they made have mistakes now, it's rather defensive. Isn't it?

[ Parent | on HN ]