News for hackers. Stuff that matters.
Re:Are Experts Real? by moomin on Monday January 11, 2021 @01:02PM (#25732957)
I think this argument conflates two things, one of which is true and slightly terrifying. The terrifying thing is how few scientists understand the statistical underpinnings of their studies. The conflation happens because he thinks this is stratified by field. In practice, there are plenty of sociologists with a decent grasp on this, and a truly astonishing number of biologists who don't. Don't believe me? Read the studies of biology papers and how many have serious problems in their statistical treatment.

So we've got a serious problem with how science is being done. Probably doesn't affect whether or not expertise exists, or which fields it exists in. Unless we're going to start saying biology isn't real.

Re:Are Experts Real? by bonoboTP on Thursday January 21, 2021 @12:13PM (#25861277)
Perhaps a possible counterpoint is to argue that fancy stats knowledge is not really necessary for biologists. The reason they have to do it in their papers may be more due to bureaucracy / cargo cult / numerical theater etc. Look at the scatterplot etc. If the details of the fancy evaluation make or break the discovery, then it's probably a fluke anyway. Yeah, most papers are uninteresting and are purely done for funding and CV reasons. Those who pay expect papers, but aren't really sure why. Certainly not to read them themselves.
Re:Are Experts Real? by jldugger on Monday January 11, 2021 @11:33PM (#25742317)
> Unless we're going to start saying biology isn't real.

It probably helps to recognize that statisticians caught one of the first modern biology researchers fudging his numbers: https://en.wikipedia.org/wiki/Gregor_Mendel#Mendelian_parado...

Re:Are Experts Real? by lmm on Tuesday January 12, 2021 @12:11AM (#25742579)
Except they didn't; they alleged that the numbers had been fudged on rather scant evidence.
Re:Are Experts Real? by jldugger on Tuesday January 12, 2021 @12:56PM (#25750598)
As I understand it, Fisher had two complaints. First, that the trifactorial data was just wildly too accurate (using a chi-squared approach). This seems to be resolved in the scientific community as an off-by-one error: if instead of 10 seeds, Gregor had used 11 on occasion, that's enough to resolve the issue.

The other issue is the chi-squared analysis of Mendel's experiments in aggregate, which when pooled also too neatly fit the pattern he wanted to illustrate. And as best I know, nobody has adaquately disputed that analysis.

Re:Are Experts Real? by lmm on Wednesday January 13, 2021 @12:34AM (#25758602)
The only actual analysis I saw came up with a p-value of about 0.07, which is just a complete nothingburger. There's no explanation for that because there's nothing to explain.