News for hackers. Stuff that matters.
Re:We're Incentivizing Bad Science by SiempreViernes on Tuesday October 29, 2019 @12:34PM (#21389065)
cought 750 GeV cough... ahem. Let me sing you an OPERA about a how Andrei Linde was astonished by the biggest BICEP you've ever seen! It belonged to a LIBRA* that was faster than light and could fly trough walls!

* Couldn't get DAMA to work :(

Re:We're Incentivizing Bad Science by knzhou on Tuesday October 29, 2019 @12:43PM (#21389166)
Sure, but there's a difference between the accuracy of speculative theory and experiment. Experiment is very reliable -- they never called the 750 GeV bump a discovery of anything, because it didn't meet the statistical standards. Even things that do meet the statistical standards are often not called discoveries, because the experimentalists think they are systematic errors at play, as we see with MiniBooNE and DAMA.

Speculative theory is not reliable, which is why all the papers on the 750 GeV bump were wrong. But it has never been reliable, because, well, it's speculative! For each new phenomenon there's probably only one right explanation, but far more than one paper. Being 99% wrong has been par for the course for almost a century.

Re:We're Incentivizing Bad Science by SiempreViernes on Tuesday October 29, 2019 @12:50PM (#21389260)
I mean, if CMS just hadn't played up their 2.3 sigma excess we probably wouldn't have had the 750 bonanza* so don't pretend there is no blood on the experimental hands :p

OPERA is a bit of a special case, but BICEP just straight up declared discovery and wanted the Nobel, have you seen their video of when they tell Linde?

* Any time I can, I link to the conclusion: http://resonaances.blogspot.com/2016/06/game-of-thrones-750-...

Re:We're Incentivizing Bad Science by knzhou on Tuesday October 29, 2019 @01:01PM (#21389404)
I agree that BICEP was the worst debacle of this kind that’s occurred in recent memory. But also see how the safeguards worked: their results were properly questioned, the hype was over in months, and they did not get a Nobel.
Re:We're Incentivizing Bad Science by oefrha on Tuesday October 29, 2019 @12:57PM (#21389348)
> BICEP just straight up declared discovery and wanted the Nobel, have you seen their video of when they tell Linde?

That’s a bit exaggerated. You mean the champagne popping video? Well, it’s somewhat awkward in hind sight, but a bit of excitement was warranted at that time. I was at Stanford around that time, might even talked to Andrei right after, and don’t recall a festive atmosphere or anything.

Re:We're Incentivizing Bad Science by SiempreViernes on Tuesday October 29, 2019 @01:00PM (#21389389)
I feel bad for his wife every time I see it now :(
Re:We're Incentivizing Bad Science by oefrha on Tuesday October 29, 2019 @01:19PM (#21389623)
She’s also a Stanford physicist. Great person.
Re:We're Incentivizing Bad Science by oefrha on Tuesday October 29, 2019 @12:44PM (#21389187)
The high profile debacles were pretty quickly caught, so I’d say the system is working.
Re:We're Incentivizing Bad Science by SiempreViernes on Tuesday October 29, 2019 @12:56PM (#21389340)
There are two aspects: how many errors are published and how they long before they are caught? The BICEP debacle is an example of a claim that should have gotten caught before it was published, doing an important calibration step using a photo of preliminary data?!
Re:We're Incentivizing Bad Science by knzhou on Tuesday October 29, 2019 @01:22PM (#21389671)
Actually, the error was caught before publication. They sent it to ArXiv, the standard pre-publication space, so that other physicists could read and comment on it. It was there that the error was quickly caught.
Re:We're Incentivizing Bad Science by SiempreViernes on Tuesday October 29, 2019 @01:44PM (#21389955)
Oh, I didn't know that. I though with all the announcements they did they had a paper ready to publish...
Re:We're Incentivizing Bad Science by knzhou on Tuesday October 29, 2019 @01:47PM (#21389993)
Well, it's all a little ambiguous. You can choose to pre-publish or not, and you can choose to announce whenever you want: before pre-publishing, after but before publishing, and at the moment of publication itself.

It's certainly true that they announced early, but it's also true that the community at large regarded it with appropriate skepticism, causing the whole thing to be self-corrected in months.

Re:We're Incentivizing Bad Science by fungicide on Tuesday October 29, 2019 @01:19PM (#21389620)
"Stanford Professor Andrei Linde celebrates physics breakthrough"

https://youtube.com/watch?v=ZlfIVEy_YOA