News for hackers. Stuff that matters.
Re:A Cornell Scientist’s Downfall by melling on Wednesday September 26, 2018 @11:36AM (#18077009)
Abusing statistics:

“Mr. Wansink’s fall from grace began with a 2016 blog post in which he blithely confessed to using improper research techniques known as p-hacking and HARKing. P-hacking involves running statistical analyses until they produce a statistically significant result; HARKing stands for “hypothesizing after the results are known.” The post prompted a small group of skeptics to take a hard look at Mr. Wansink’s past scholarship. Their analysis, published in January 2017, turned up an astonishing variety and quantity of errors in his statistical procedures and data.”

Re:A Cornell Scientist’s Downfall by soperj on Wednesday September 26, 2018 @12:34PM (#18077666)
>The post prompted a small group of skeptics to take a hard look at Mr. Wansink’s past scholarship

It's funny that this is basically the peer-review version of harking.

Re:A Cornell Scientist’s Downfall by pcrh on Wednesday September 26, 2018 @01:12PM (#18078088)
It's also pretty close to the Baysian approach. The difference being that in the Baysian approach one is "permitted" to revise the hypothesis as new data is acquired.
Re:A Cornell Scientist’s Downfall by antidesitter on Wednesday September 26, 2018 @04:42PM (#18080083)
Correction: Bayesian, not Baysian.
Re:A Cornell Scientist’s Downfall by theshadowknows on Wednesday September 26, 2018 @12:36PM (#18077688)
You just wrecked my mind
Re:A Cornell Scientist’s Downfall by kradroy on Wednesday September 26, 2018 @02:26PM (#18078843)
I've never heard the term "HARKing" before. This is exactly what my advisor had me do on our experiments that couldn't confirm our initial hypotheses. I knew it was wrong because we set up the experiments in a way to eliminate confounding variables. So any conclusions drawn on data for hypotheses outside of those would be suspect. The experiments we ran were costly in time to do because we were using feedback from students using our learning system over a semester.

I quit working with her because of that, and also because she was a total asshole. I refuse to donate to my university until she's no longer on the faculty. I don't want her benefiting from my hard-earned money.

Re:A Cornell Scientist’s Downfall by MrEfficiency on Wednesday September 26, 2018 @02:32PM (#18078901)
This is why I believe in Engineering and not the modern "Academia Science".

Totally corrupt, Ive seen it when I talked to professors about getting my PhD. You prove what they want proven.

One is going to have millions of customers using it, the other is going to have a few biased professors review the data.

Re:A Cornell Scientist’s Downfall by vkou on Wednesday September 26, 2018 @03:08PM (#18079249)
If you think this is any different from how industry works, you have not spent enough time in industry.

After-the-fact-hypothesis is constantly used to retroactively justify business decisions.

Re:A Cornell Scientist’s Downfall by MrEfficiency on Wednesday September 26, 2018 @03:14PM (#18079294)
I have 10 years in Industry, testing hypothesis is testing.

Building a product that is bad because 'X person wanted it' is bad Capitalism and will be punished.

Academia doesnt have this same customer focused delivery.

Re:A Cornell Scientist’s Downfall by rossdavidh on Wednesday September 26, 2018 @06:11PM (#18080687)
Hmmm...I think it depends on how fast the feedback loop of bad sales is. There are lots of cases where somebody inside a corporation wants the answer to be "X", because that's what they had advocated. It may be worse for the corporation as a whole, but it's better for that guy's career, and if the hit to the corporation is not immediately visible.
Re:A Cornell Scientist’s Downfall by rossdavidh on Wednesday September 26, 2018 @12:02PM (#18077303)
Oh, if only we had a system to pass articles that are submitted to scientific journals to some sort of expert committee, that could look at it and see if it was likely to be valid. We could call it, I don't know, "peer checkup", or "expert review", or...oh never mind.
Re:A Cornell Scientist’s Downfall by sn41 on Wednesday September 26, 2018 @12:13PM (#18077431)
The issue is that peer review never pays off directly. The time spent in reviews mostly goes down a black hole. Editorships are awarded based on publication record, and not quality of reviews.

As a result, more and more, reviews will tend to be shallow and uncritical.

Re:A Cornell Scientist’s Downfall by rossdavidh on Wednesday September 26, 2018 @02:35PM (#18078938)
Truth.
Re:A Cornell Scientist’s Downfall by ble on Wednesday September 26, 2018 @12:12PM (#18077410)
Peer review can't fix broken incentives.
Re:A Cornell Scientist’s Downfall by nonbel on Wednesday September 26, 2018 @05:01PM (#18080247)
He also shamed a post-doc who refused to do it: https://web.archive.org/web/20170312041524/http:/www.brianwa...
Re:A Cornell Scientist’s Downfall by sampo on Wednesday September 26, 2018 @08:50PM (#18081428)
"In the meantime, this Turkish woman's resume will always have the five papers below."

Turns out it won't: 2 of the 5 papers have been retracted.

https://www.frontiersin.org/articles/10.3389/fpsyg.2017.0214...

https://bmcnutr.biomedcentral.com/articles/10.1186/s40795-01...