News for hackers. Stuff that matters.
Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @03:07PM (#15510688)
> The "scientific venue" has been corrupted

That's a pretty strong accusation. Do you have any evidence?

Cuddy herself, in the linked article, even asks: "Why not come to a conference or hold a seminar?"

I don't think you're wrong about the lack of quality reviewing, but I also think that blogs and Facebook and articles in pop sci news venues are pretty shitty places to address the quality of editorial review.

And your post demonstrates why: honest mistakes -- or even complete non-mistakes stemming from gaps in established best practices! -- turn into out-right accusations of full on corruption. The comments on NYT demonstrate the same problem from the other side: lots of gender politics when Gelman wasn't motivated by gender, implicitly or otherwise, but rather by the mass appeal of Cuddy's work.

Needless to say, I also think you're massively over-stating the maliciousness of people like Cuddy and Fiske.

> Science was being done sloppily, and Fiske was both a beneficiary of that and in a role where she could have prevented it.

Simmons seems to agree with me that you're really over-reaching here: "The original study wasn’t particularly egregious," he said. "It was published in 2010 before anyone was thinking about this."

There's a huge difference between doing science the way you were trained (but sub-optimally), and outright "corruption".

There's also a HUGE difference between noticing a problem and constructively pushing for more rigor within a sub-community, and going after particular people within that community so harshly you destroy their careers.

The former is great for science. The latter might possibly by great for improving rigor (I'm pessimistic and think it all comes down to incentives, which Gelman et al don't really do much to change). But equivocating bad methodological/statistical training/practice with unethical and even criminal ("corrupt") behavior? That sort of dishonest fire-and-brimstone talk is just as damaging as a lack of rigor.

Re:When the Revolution Came for Amy Cuddy by mattmcknight on Thursday October 19, 2017 @04:45PM (#15511398)
"That's a pretty strong accusation. Do you have any evidence?"

Fiske is the journal editor. Fiske is allowing articles with weak stats to get published. Fiske is publishing her defense in that journal. Fiske is not publishing critical articles in that journal. That's corruption based on her position of authority.

Cuddy just had sloppy stats and her results failed to replicate. Notice how you deceptively switch to Cuddy from Fiske in your response, because you have no point about Fiske.

Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @05:19PM (#15511636)
> Fiske is publishing her defense in that journal

APS Observer is a magazine, not a journal.

Furthermore, Fiske was not the president of APS or an editor of the Magazine when that article was published. And even if she were, what's the problem? I see letters from the editor in most magazines I read on a very regular basis.

Finally, the claim that Fiske was construing her opinion on conduct as a scientific fact is just... well.

I'll refrain from calling you corrupt or deceptive because it was probably just a misunderstanding :-)

> Notice how you deceptively switch to Cuddy from Fiske

I actually have no idea what you're trying to say or what this refers to. Can you be more explicit?

Re:When the Revolution Came for Amy Cuddy by conistonwater on Thursday October 19, 2017 @03:25PM (#15510837)
Just so you know, the basic statistical problem with this type of research was pointed out back in the 60's (http://andrewgelman.com/2016/05/06/needed-an-intellectual-hi...), it's just that nobody listened.
Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @03:39PM (#15510934)
My point is that:

1. failing to have read Meehl's critique doesn't amount to "corruption",

2. that calling people "corrupt" for having failed to read Meehl is not likely to be the most effective or the most civil path toward changing things, and

3. To the extent that discussion of scientific methodology on public forums causes or contributes to (2), that's a bad thing and perhaps suggests a fundamental cost of doing science in this manner.

Re:When the Revolution Came for Amy Cuddy by conistonwater on Thursday October 19, 2017 @03:53PM (#15511044)
I think you're using a different sense of the word "corrupt" from the one in the post you're replying to ("The "scientific venue" has been corrupted."). I know it's easy to lose nuance in internet discussions, but please read the posts above more carefully/charitably. Nothing Cuddy did was corrupt in any sense, only poor science.
Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @04:05PM (#15511116)
I re-read the comment, and disagree. The preceding sentence is: Fiske controls the venue and is (mis-)using the "scientific venue" to denounce her critics

I'm having trouble finding a charitable way to read the claim that someone is misusing a scientific venue.

And much more to the point, I doubt even more that the subject of those sentences (or the e.g. tenure/promotion committee of that subject) could be reasonably expected to apply such an abundance of charity.

Re:When the Revolution Came for Amy Cuddy by mattmcknight on Thursday October 19, 2017 @04:49PM (#15511431)
How's this- Fiske publishes a letter critical of Gelman, with no peer review of said letter, in her journal. She then claims her letter is "science" because it is in a scientific journal, while his self-published piece is "methodological terrorism."

In a sense, both pieces are self-published, and she is using the mantle of Science to falsely claim that her self-publishing is superior because of the authority of her position as editor. This is corruption. This is misusing the scientific venue.

Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @05:37PM (#15511749)
> She then claims her letter is "science"

Please link to the place where she actually makes this claim.

> in her journal

Not hers, and not a journal.

> while his self-published piece is "methodological terrorism."

She actually outlines the practices that ought to be singled out as unprofessional and unacceptable in the second to last paragraph, and none of those are mere self-publication.

Have you considered the possibility that both sides are wrong? That this is crap science, and that the conduct of certain groups of people rallying against crap science is overzealous to the point of cruelty?

Finally, it's also worth noting you've COMPLETELY proven Fiske's point about social media: sure, there are some valid critiques. But there are also people being absolutely vicious to people actually trying to science because of very trivial and obvious misunderstandings (e.g., because they think that APS Observer is a journal). I think to some extent that's a reasonable price for free discourse when things stay online and especially when they're anonymous, but you're calling a real person with a real job on the line corrupt because you made an incorrect assumption (that would've taken you 10 seconds of googling to correct).

Re:When the Revolution Came for Amy Cuddy by mattmcknight on Thursday October 19, 2017 @08:46PM (#15512765)
I talk about the problems with Fiske and you say:

"Cuddy herself, in the linked article, even asks: "Why not come to a conference or hold a seminar?""

I am not criticizing Cuddy. Fiske is editor of PNAS, former president of APS, and is putting her criticisms in APS Observer. The difference between a journal and an official magazine of a scientific organization is irrelevant in this concept, in that the supposed superiority of an edited journal is what is in question here when the editor is not good, and is not considering the context of the discussion.

I am pointing out the utter hypocrisy in her argument that you shouldn't point out statistical errors on blogs, while she is pointing this out in a publication she controlled. She wants people to be able to protect their undeserved status, it is clear.

The entire idea that science needs to be locked up in limited access journals (or magazines) is not a good one. The real issue is that the quality of PNAS has been pretty low. Fiske's response to that is to try to discourage open criticism. Open data is one of the reasons that people were able to find these errors. Resistance to publishing failed replications is not proper behavior. We have now seen PNAS publish a few letters describing errors, and hopefully the standards will improve. However, it hardly seems like a person whose response is to lean toward hiding the discourse is the right person to do it?

Re:When the Revolution Came for Amy Cuddy by mattmcknight on Friday October 20, 2017 @01:40PM (#15517670)
Here's an interview with the brave researcher who asked her about this at a conference. Her quote "There is no mechanism in place that holds researchers accountable for practices that lead to a corrupted literature but cannot clearly be classified as fraud" is probably a less aggressive version of what I am saying.
Re:When the Revolution Came for Amy Cuddy by mattmcknight on Friday October 20, 2017 @09:52AM (#15515736)
Here's a paper she edited on corruption. The conditions are there: http://www.pnas.org/content/112/34/10651
Re:When the Revolution Came for Amy Cuddy by conistonwater on Thursday October 19, 2017 @04:22PM (#15511242)
Think "corrupted file", not "corrupt official". The key difference is that there is a primary purpose for their existence (a file stores data, a scientific process produces good and reliable findings), and something can be corrupted (no longer suitable for its purpose) without malice involved. To call an official corrupted, you need to allege malice, to say that a file is corrupted, you only need to show that it's not valid for its purpose. It's not a good choice of a word anyway, you could make exactly the same valid point without any of the ambiguity.
Re:When the Revolution Came for Amy Cuddy by throwawayjava on Thursday October 19, 2017 @04:35PM (#15511339)
edit: My defense of my reading isn't necessary; just see OP's sibling post. I interpreted their post correctly.
Re:When the Revolution Came for Amy Cuddy by conistonwater on Thursday October 19, 2017 @05:54PM (#15511861)
Ugh, yeah.