News for hackers. Stuff that matters.
Re:Clumps of human brain cells in a dish can learn to play P... by wolverine876 on Sunday December 19, 2021 @06:41PM (#29619825)
Perhaps that's in the HN comments more than in the research. IME, for as long as I've read HN, commenters have claimed to have found errors in methodology or similar basic problems. I don't know if I've seen any research posted that didn't receive that response.
Re:Clumps of human brain cells in a dish can learn to play P... by gus_massa on Sunday December 19, 2021 @08:28PM (#29620601)
Note that it's increasingly common to discuss preprints, like in this case. A preprint is as reliable as a blog post in WordPress, unless you work in the area and know that the author has a solid track record.

Also, most results that reach the front page here are groundbreaking. But groundbreaking results are very rare, so most of them must be fake, because they have an error or because they are an exaggeration.

Most good results are too technical and boring. My favorite example is Magnetoresistance. It's a weird quantum effect that is caused because electrons can have spin up or down. It has a huge effect in the applications and almost everyone had a device that used it. Now the applications are fading. But no one knows it.

There are probably 1000 times more discussions here about faster than light travel than magnetoresistance.

Re:Clumps of human brain cells in a dish can learn to play P... by wolverine876 on Sunday December 19, 2021 @11:06PM (#29621477)
> A preprint is as reliable as a blog post in WordPress, unless you work in the area and know that the author has a solid track record.

While preprints lack some work and signals of reliability, such as peer review, revisions by the author, etc., I think they are far beyond blog posts. Imagine a blog post, by an expert in the domain, with the amount of research and precision that goes into a preprint - there's no comparison.

Nothing, not even a peer-reviewed article in Nature, is so reliable that we can just put away our critical thinking.

Re:Clumps of human brain cells in a dish can learn to play P... by gus_massa on Tuesday December 21, 2021 @08:34PM (#29644521)
There is a lot of variation, for example https://terrytao.wordpress.com/ and I remember some guy that claimed that got a fantastic method for factorization that broke RSA and posted it in the arxiv, and the first 5 page of the preprint was an explanation of the rule of nines. (If the sum of the digits of a number is divisible by 9 then the number is divisible by 9.)
Re:Clumps of human brain cells in a dish can learn to play P... by zzt123 on Sunday December 19, 2021 @07:50PM (#29620349)
I feel like academica kind of incentivizes this. It’s hard to resist without a good base of support, and I feel like having such a base isn’t the average. I notice this pressure felt strongly across the board by my friends who are adjuncts (or tenure-track, but not yet tenured) in the soft sciences. But this is just anecdotal of course.
Re:Clumps of human brain cells in a dish can learn to play P... by wolverine876 on Sunday December 19, 2021 @11:41PM (#29621643)
> I feel like academica kind of incentivizes this. It’s hard to resist without a good base of support

Incentivizes what? What is hard to resist?

Re:Clumps of human brain cells in a dish can learn to play P... by zzt123 on Monday December 27, 2021 @05:33AM (#29701273)
Getting a certain volume of publications out. It can be problematic for example when you discover a minor data issue which might not materially change the thesis in your opinion, but if one were wholly following academic guidelines, would warrant delays while you attempt to fix the data issue, if possible.

I’ve seen this happen a few times in papers that were never fixed, nor the issue brought up as far as I’m aware. Granted, in each case the thesis was still fine but… makes me wonder about the cases I don’t know about. One of the cases skirted really close to the edge of bs.