A new replication crisis: Research that is less likely to be true is cited more

Re:A new replication crisis: Research that is less likely to... by MichaelMoser123 on Saturday May 22, 2021 @07:27PM (#27251162)

may i ask what field of knowledge the manipulated paper was from? Your page lists CS/NLP, so that field may also be linguistics or neurology (linguistics which would be easier to swallow for me) https://scholar.google.com/citations?user=FMScFbwAAAAJ&hl=en

Some wider questions would be: Are there similar problems in Mathematics/physics versus the life sciences/other social sciences? Are there the same kind of problems across different fields of study?

Also i wonder if replication issues would be less severe if there was a requirement to publish the software and raw data that any study is based on as open source / data. It is possible that a change in this direction would make it more difficult to manipulate the results (after all it's the public who paid for the research, in most cases)

[ Parent | on HN ]

Re:A new replication crisis: Research that is less likely to... by obviouslynotme on Monday May 24, 2021 @04:54PM (#27269582)

I worked at a prestigious physics lab working for the top researcher in a field. It absolutely happens there and probably everywhere.

The only way to fix replication issues is to give financial and career incentives for doing replication work. Right now there are few carrots and many sticks.

[ Parent | on HN ]

Re:A new replication crisis: Research that is less likely to... by MichaelMoser123 on Tuesday May 25, 2021 @06:58AM (#27275308)

Thanks! So all this is probably happening accross the board, amazing.

[ Parent | on HN ]