There's a proud history of publishers helping each others against outside threats (eg in 1960's Germany during the Spiegel-Affair the right-leaning "Bild" daily paper provided office space and printing presses so the left-leaning weekly "Spiegel" could continue to operate after a police raid shut down their operation).
In that light, I'd love to see a publication of the paper in some journal, maybe an earlier version with less of the political cruft. Potentially prefaced with some explanation: "The following paper may not match our usual standards, but it was subject to political interference which is at odds with scientific freedom."
That would also allow open critique (with proper citation of its subject matter) instead of the back-handed mess that apparently went on for the last 18 months or so: You shouldn't need FOIA requests to find out about counter-points to scientific publications.
My opinion of the declining quality of scientific and especially mathematical papers is different. I used to work in medical and molecular imaging. Whatever we did obviously required FDA approval. One engineer, a good one, but engineers aren't usually very detail oriented when it comes to "getting the math right" so to speak, referenced a paper in some of the documentation to some code. Long story short, the paper had been peer reviewed, but was riddled with material errors. I caught the issue in our internal review process, and removed the incorrect code and reimplemented the feature correctly. (Was highly annoyed at having to essentially write my own paper for documentation and FDA submission).
Here's the point though, we're already putting out too many poor quality papers. (And calling them "poor quality" is being charitable.) Why is the mathematics community being pressured to go even lower quality?
I took the liberty of reading this "paper", and there's no meat in it. Put it in the Intelligencer, or in Wired, or on HN, or Reddit or whatever. But let's try to get actual journals cleaned up. The way this should to work is that people like the engineer at my company, should be able to cite a peer reviewed scientific paper from a peer reviewed journal. (Or a mathematics paper, in that particular case). But right now that's an unsafe practice where the safety of a human life is potentially a concern. The quality problem is out of hand right now. (And it's not just the "paper" that is the subject of this article, low quality papers abound out there, believe me). My question is, why are we intentionally asking to make the issue worse?
If quality had been the only argument, I'd buy it - but[0]:
- “As a matter of principle,” she wrote, “I support people discussing controversial matters openly … At the same time, I think it’s good to be aware of the effects.”
- “but you should know in advance that many (most?) of us have strong disagreements with what you did.” (not "with the quality of the work", but "with what you did")
- "people who explained that the paper was “bad and harmful”" (there _could_ be a quality argument in there depending on what was meant by "bad", but harmful is not a quality category)
> Put it in the Intelligencer
That's what Hill tried first: "Once we had written up our findings, Sergei and I decided to try for publication in the Mathematical Intelligencer, the ‘Viewpoint’ section of which specifically welcomes articles on contentious topics"[0]
As told by Hill, it wasn't his decision that it didn't end up there.
> But let's try to get actual journals cleaned up.
NYJM only appeared on the scene after the Intelligencer was pressured into not publishing. In NYJM case, probably due to political interest of one of its editors (seeing the edits made), sadly not merely due to "I stand for journals' press freedom".
> My question is, why are we intentionally asking to make it worse?
Because the more reasonable alternative was prevented by others. Even just publishing it in the Intelligencer now would be an option to make the entire situation whole again (apart from the year or so wasted on a messy situation). After that, ridicule the paper's result all you want in the Intelligencer or any other journal.
In contrast the outcome that seems to be preferred by the paper's opponents, which is "don't dare talk about it", doesn't sound very sciencey to me.
[0] https://quillette.com/2018/09/07/academic-activists-send-a-p...
Look, I understand the political argument you are making, but politics has no place in peer reviewed scientific and mathematics journals. Quality is always the argument, or should be.
If people want to have a political argument, take it elsewhere. There are a lot of people out there doing serious work who are relying on the reliability of the information presented in peer reviewed journals. The political people have, quite literally, the entire world outside of peer reviewed journals to engage in their flame wars. The mathematics community should be pushing back on stuff like this. As I said, it's not a problem if you'd like to publish that stuff elsewhere, it's appropriate in other venues. But you can't just be publishing whatever you like in a peer reviewed journal.
It's particularly galling that the political people had so infested NYJM that they decided to simply dispense with the formality of peer review in the case of this particular paper.
Why?
Presumably because it agreed with their politics.
I mean, that's literally some "Sun revolves around the Earth .. you can't question this .. great doctrinal import" type stuff.
Come on people.
Please, TRY to be reasonable here. I'm not saying you can't have the flame wars you want to have, I'm just asking that we not put low quality science or math papers in peer reviewed journals. Especially papers so low quality that you feel the need to exempt them from peer review lest they not get published.
For example the Intelligencer? So why did folks cause a ruckus to prevent that?
Not having a political argument in a journal also means having freedom from politics. That was denied to both the Intelligencer (by outside parties) and NYJM (arguably by both outside parties and the editor who rushed in that paper).
> It's particularly galling that the political people had so infested NYJM that they decided to simply dispense with the formality of peer review in the case of this particular paper.
I agree - however, NYJM wasn't the first episode of the paper but (so far) the last.
> Please, TRY to be reasonable here. I'm not saying you can't have the flame wars you want to have, I'm just asking that we not put low quality science or math papers in peer reviewed journals. Especially papers so low quality that you feel the need to exempt them from peer review lest they not get published.
Here I disagree. First, the plea to be "reasonable": I think I'm quite reasonable asking to undo the damage by undue interference. Second, I don't think scientists will have issues handling a properly annotated paper (ie "we publish it here not for its quality but because some people want to keep it hidden for non-scientific reasons") in a sensible way.
Publish it freely on the ArXiV or whatever, but this argument that some publication has to publish because "politics" or "freedom" or whatever... why don't I get to throw a tantrum & get them to publish my stuff (which is actually math!) so I can get a raise? I need a raise.
Admittedly, I'd aim for Advances instead of the Intelligencer!
Apparently not?
You can't be serious.
Here's how it should work, ideas that survive rigorous examination should be published, because that is how merit is measured in the context of peer reviewed journals. What else are scientific and mathematical ideas to be judged on if not merit?
So now we'll allow people to be published because of popularity? Or lack of popularity? Or who has the best hair style?
I think I'm done here.
You guys have a nice rest of your day.
Papers should, in general, be judged by their merit. The editor of the Intelligencer did so and wanted to publish it in "Viewpoints", essentially an op-ed section.
That was shot down. Not for quality, or unsuitability for the medium, but because of a political campaign. Therefore the paper was _not_ judged for its merit.
Somebody ought to make it whole - ideally the Intelligencer, but I can understand if they don't want to take on the dumpster fire again that is political activism in academia. Second best is another journal that could open with a disclaimer like above to clarify what's going on.
Both to give closure to an author who is in a state that shouldn't happen in academic publishing (published but not published) and to make clear that scientific merit is what decides what ends up in a journal and not activists.
--
Somewhat but not quite unrelated:
I predict that we'll see a similar situation (a minor paper left in limbo after it got depublished due to unscientific activism and backroom pressure) in a couple of years again (within the next 5 years), with some progressive topic being suppressed.
I also predict that there will tons of outrage over that by the very same activists that are very pleased with themselves today over the outcome of the current campaign.
1. The underground inclusion by a single editor, seemingly bypassing their processes and the other editors
2. The revisions to politicize the paper explicitly (potentially on request of that editor)
3. Lack of context on how and why that paper ended up in the journal even though it's not in line with its normal body of work
4. The silent removal, again bypassing publishing processes (eg retraction)
5. The reuse of the pages taken up by the paper with some other paper. Depending on how this turns out, the new paper will be in the uncomfortable position that its citations are mixed up with citations for another, controversial paper. It might have been better to leave the pages empty except for some explanation about what happened to the paper that used to be there, if only to keep it fair for the new paper.
All around it's a mess.
Why I'm referring to the Intelligencer all the time is that Hill and Tabachnikov wanted to place it in the Intelligencer first, and they likely knew about its standing in the math community, so they probably agree with your assessment of the paper's mathematical value.
At least as told by Hill, NYJM only entered the picture because a mob forced the Intelligencer to give up and then because Rivin turned up, and considered a fast track possible (and then, it seems, doctored the process at NYJM to implement that "quick referee").
I consider mob rule a bigger threat to publishing at large than a one-off weak paper that went in. We have enough of the latter (and while we should strive to minimize them, we could live with one more), but IMHO we need to discourage the former before it becomes the new normal.
Therefore my proposal to publish it somewhere of at least equivalent stature (to the Intelligencer, the original publication the paper should end up in) that offended bilbo0s so much: show the mob that backroom campaigning isn't welcome.
I'd prefer it done with proper processes and a big, fat disclaimer though, not like what apparently happened at NYJM.
I guess that doesn't apply to the NYJM, but I didn't ask for them to be the journal doing the publishing (just noted that their approach of dealing with the fallout of Rivin's machinations was unfortunate).
If push came to shove and I'd be on the board of editors of a publication of same or higher posture than an affected publication with overlapping audience, I hope I'd at least consider doing that (but as mentioned: not through subterfugue, but officially).
That's political, but in a way it's merely self-preservation: Niemöller's poem "First they came ..." and all that.
But I disagree with you that a real journal has a duty to maintain a bad-faith off-topic out-of-process submission. That's a disservice to the cite record.
So completely removing a paper that was published in violation of process is a process violation itself, undermining the reliability of citations. At least they replaced it by a paper of the same length, hopefully preventing any following papers from moving around, but they really shouldn't reuse space like that. Especially considering it's an online journal where pages are essentially free.
Something about the hypothesis itself:
The variability hypothesis seems plausible, but there seems to be little evidence linking it to biological differences.
Variability differences undoubtedly exist, but not universally and not with same degree across cultures. As the measured variance is very culture dependent and even disappears, existing data does not support the hypothesis linking it to biological differences.
There is also strong negative correlation between variance ratio (VR) and mathematical performance. (r = -0.640, p < 0.001). VR = (variance in male scores) / (variance in female scores). The variance is higher where math scores are lower.
source:
Debunking Myths about Gender and Mathematics Performance http://www.ams.org/notices/201201/rtx120100010p.pdf
> Therefore, we conclude that both variance and [variance ratio] in mathematics performance vary greatly among countries. Confirming our earlier finding ([21]), we also conclude that [variance ratio] is reproducibly essentially unity for some [predominantly muslim or low gender equality] countries. These findings are inconsistent with the greater male variability hypothesis.
If we're trying to draw conclusions about innate differences operationalized as distribution test scores, any kind of biased schooling undermines the ability to draw conclusions from that population.
If culture affects the outcome, it waters down the premise of the variability difference theory.
And what is unusual about Czech Republic, where VR and gender gap were near unity and zero?
Couple of points here. A culture biased along gender lines may bias the outcome thus obscure the effect of genetics on gender differences. Also, no one in their right mind claims that environment has no effect, and so measuring some environmental influence doesn't undermine the greater male variability hypothesis.
>And what is unusual about Czech Republic
I wouldn't hazard a guess, but the "paradoxical effect" of gender equality negatively correlating with female interest in STEM might have some hard-to-tease-out influence here.
What is strange is that a paper is "disappeared"!
It doesn't matter how silly the paper is, the problem is that they are treating their readers as idiots.
Who was that friend of his? Rivin, the editor who contacted him after learning about the article from his co-author, Steinberger, the editor-in-chief and founder of the journal who decided to publish the paper, or the unnamed referee who had a very positive opinion?
Still, if it should be so obvious to any casual observer that the paper doesn’t belong in that journal: how did that escape the journal’s founder and editor-in-chief? (Maybe Rivin was also impersonating Steinberger!)
I don't know exactly where I got the impression that Rivin was the person who got this paper fast-tracked, but I think probably somewhere on Joel Fish's Twitter timeline.
As I understand it: NYJM is an online-only journal that continually adds papers to each "volume", so it's not like a typical refereed journal where there's a cohort of submissions and a calendar during which the whole peer review committee downselects submissions. You couldn't, for instance, easily fast-track a Usenix paper into a conference proceedings without blowing up the program committee.
And, again: you can just look at NYJM and then at this paper and see immediately that it didn't go through peer review. It is unlikely any paper I've found in NYJM for several years back. There are practicing mathematicians on this thread saying the same thing; Tim Gowers also says as much in the blog post we're commenting on.
What do you mean? Do you expect the whole editorial board to review every paper? I think it’s usual for acceptance to be decided by one editor, based on the report from referees (in the case of the NYJM, one referee). Peer review is provided by the external referee(s), not by the journal editors (but they can also act as reviewers for submissions handled by another editor, I guess it depends on the journal’s policy).
(It is, for whatever it's worth to you, also essentially the practice at Black Hat USA, which gets thousands of submissions every year --- albeit the review board is separated out into tracks with their own covering reviewers. But BH Cryptography, for instance, has 10 cryptographer reviewers, and they reviewed everything on the track).
Can I ask, from where did you get the impression that it was typical for an individual member of a review board to get assigned a paper and pass/fail it, or for any one review board member to have the authority to accept a paper?
Editors normally invite more than one reviewer to evaluate a scientific manuscript.
Even if there were two referees instead of one, they are usually external and not members of the editorial board. And you could still believe that no peer review was done or suspect that both referees were the handling editor himself.
Apparently in this case the final decision is taken by the editor-in-chief. Other academic journals may have other policies and maybe in some cases the whole editorial board is involved in every publication but I don’t think it’s usual.
Would you argue that Social Text would, in that situation, still have some sort of duty to publish the paper? Would you argue they'd have a responsibility to give it a prominent, permanent, place in their archives to avoid accusations of having "disappeared" it? Would you argue that they'd need to air that dirty laundry in public? If they did air it all publicly and honestly, would you treat that as a form of bullying of Sokal and his accomplice(s)? Remember: that would be the powerful journal leveling accusations of deliberate fraud against an academic who submitted the paper, and accusations of, at the very least, dishonesty and violation of review processes against one of their own.
Yes, airing the problem as publicly as possible would be the right thing to do, out of respect for the readers of the journal.
Removing the paper from the publication record is acceptable, as long as it is done very openly, as a kind of "erratum".
A retraction would have made clear what the problem with the paper was. Sure, publicly saying "we made a mistake" sucks, but not doing so empowers the author of the paper to claim they are being persecuted for their beliefs.
Or simply imagine so, given a lack of information.
I'm still trying to sort this out.
So this entire thing boils down to "Not-so-good pop-math piece is hated by some. It is first accepted by a journal, then rejected without comment, leading the authors to believe it was a deliberate campaign that led to their rejection, not the quality of their work"?
And the proof that it was a quality issue that caused it to be pulled?
I'm thinking we still don't know. All I know from reading this thread is that the article doesn't match up in quality against others that were published. I'm not saying this thread is wrong. I'm saying that speculating on the quality of the work is as much bullshit as the authors claiming it was a campaign. To your point, without a clear retraction, it's just people making stuff up -- based on stuff they already believed long before this paper ever came along.
So far? Not so much. But admittedly, only the flame-throwers get the media attention. I neither know nor care about this. The only reason it interests me is the quality of the debate, which I would hope among mathematicians would be a little better than average. (Since I admire them so)
And all the other comments regarding other journals and their consistency of quality is where, exactly? I'm also missing any discussion of standards to judge quality articles and their application (or lack thereof)
I must be missing it because to me it looks like a bunch of usual political crap.
Assuming charitable intent, I understand that you might want to talk about honing one's ability to "read and evaluate journal articles" instead of what this turned out to be. That'd be cool. I'd like to read more of that. Sounds great.
1. Go to NYJM and select a bunch of articles at random.
2. Read Hill's article.
3. Observe that NYJM papers are all wall-to-wall theoretical math.
4. Observe that Hill's paper has hardly any math at all, and inexplicably ends with an appendix with quotations about male variability, which is itself longer than the elementary "proof" in section 5.
It's simply not a theoretical math paper. Journals have subjects. NYJM's subject is not this.
Papers like that are far more often published in applied math (look, we can apply this math to that problem) or computer science (look, we can apply this ML algorithm fruitfully to this type of data, for instance). I have sympathy in trying to find journal homes for these types of papers, because I'm looking for journal homes right now for some very interdisciplinary papers (applications of topology or algebraic geometry to finance). Often it seems you have to have really amazing results so you can publish in a general-interest science journal, because the math journals are so specialized they won't consider something like my papers or this paper.
You don't have to accept anyone else's judgement on the quality of the paper, although Tim Gowers is a guy who knows his math. A cheap shot here is to search for the word "theorem" in the provided arXiv text. Doesn't appear. Ok, the authors are so modest that they only prove propositions, not theorems -- but that is a sign it's not a real math paper! Then look at the propositions themselves. Prop 7.1, the first of a grand total of three propositions in the paper (no lemmas): a particular normal distribution is more variable than another if the... variance of the first is bigger. Wow. Sure, the authors say "the following simple proposition may be well known" but dang, this is not groundbreaking. This is barely mathematics.
Try following through the proofs of the three propositions. It really is at an undergrad level -- I'd be happy assigning some of these 'propositions' as homework exercises in the class I'm teaching now except we have more useful material to cover. There are also some problems the authors should have addressed regarding the subpopulation assumptions, etc. A good article of this type would have done additional modeling to address that. If I were reviewing it, I'd like to see a breakdown say of the different results given initial values of parameters (I'm a total sucker for wall-crossing or regime-change-type results -- like, cross this wall in the space of parameters and the behavior of the model will change in this way. Think phase planes in differential equations: https://en.wikipedia.org/wiki/Phase_plane or regime-change results in economics). A dynamical systems analysis would be cool, but I'm biased like that. Analysis of robustness or sensitivity would be nice. I'd want to see comparison with other models, or applications of these models to other topics. The author could have replaced the non-math appendix full of useless crap with this material.
It's really important to be able to argue that your model isn't just a one-trick pony if you want to call it math -- you need to show it's a useful model with interesting mathematical properties that you can elucidate in the paper. This paper doesn't do that.
Otherwise it looks like you assume the result of this path without helping us actually walk it.
Somewhere in the middle he linked to the paper: https://arxiv.org/pdf/1703.04184.pdf
From there you can get to its abstract page that also carries the versions: https://arxiv.org/abs/1703.04184
So I went through more than half of abstract versions and the article itself, struggle to find anything scandalous there. I persuade everyone to do the same.
https://quillette.com/2018/09/07/academic-activists-send-a-p...
Thanks!
This version is some ways worse than the Arxiv version: it opens with an invocation of Summers and Damore, and the "Proofs" section lacks the disclaimer about him "proving" elementary conclusions in probability because he hasn't seen the proofs written down anywhere else.
My impression too, admittedly as a non-mathematician. The Damore invocation is especially damning.
When I dredged this up I couldn't help but find it funny that the standard of "suppression" in an online-only journal is removing a PDF from the HTML listing of said journal while leaving the actual PDFs and abstract up.
It's not "libertarian" in the way Reason magazine is, or "right-wing" in the way that Fox News is.
I think its editors broadly identify as "classical liberals", and they have a stated mission of challenging the "blank-slate" view of human nature.
You can disagree with these positions, but they're legitimate subject areas that reasonable people can discuss, and it deserves better than to be dismissed as you have - even if some of its articles get it wrong, as this one seems to have done.
This is incoherent: either you're a believer in something like Locke's "free and equal in the state of nature", or you're not a "classical liberal".
I guess the point is we've had ~350 years of scientific discovery and philosophical musings since Locke, and we still don't have simple answers to any of this stuff.
I don't think any serious commentator today (on Quillette or elsewhere) would argue that the existence of some degree of innateness of human nature should pre-determine anyone to a lesser level of freedom or equality or ability to thrive in the world.
I think they'd argue that a better understanding of the former is necessary in order to improve the latter.
At least I would, as someone who has significant skin in the game in terms of my own ability to function.
I happen to be sympathetic with a lot of their viewpoints, but it is in fact very axe-grindy. Reason magazine comes off as a lot more reasonable to me than Quillette, despite not being a libertarian, because it's less reactionary.
I'm with you on the axe-grindiness of Quillette, and since you mention it, that's probably why I don't read it much anymore.
"Libertarian" can mean all kinds of things these days, but in the comment to which I was replying, the description connotes associations with things like: extreme positions against state welfare and gun control, extreme laissez-faire economic policy, social Darwinism, Ayn Rand, the Tea Party, etc.
In my (admittedly limited) experience, these themes seem to appear quite frequently in Reason Magazine, and they certainly do on Fox News.
They aren't a focus for Quillette, however, which in my experience, generally embraces more moderate/centrist (i.e., classical liberal) positions on economic and social issues.
The axe-grindiness to which you refer would stem from the fact that a big part of its raison d'être is to confront what it sees as the ideological corruption of academia.
I agree it can be quite histrionic in its coverage of this issue, and it doesn't hold much interest for me.
But it still matters to demarcate between "highly partisan libertarian-right" and more moderate, sober ideological positions.
It's important to know a bit about the venues in question. Mathematical Intelligencer isn't really a journal at all; it's literally a magazine, carried on the shelves it bookstores. It runs some original research but also poetry and jokes and general cultural coverage.
NYJM is, on the other hand, a serious (if online-only, lower-tier) theoretical mathematics journal.
Ted Hill's paper is light on mathematics. As Joel Fish, an assoc. math prof at UMass Boston described it, it's of the caliber of an undergraduate applied math homework problem. It's also packed with citations to psychology, ev-bio, and current events.
Arguably, Hill's paper was reasonable for Intelligencer. But it had no place whatsoever in NYJM, which basically never runs anything but hardcore proof-heavy theoretical mathematics. In the very most charitable interpretation, Hill's paper is an applied math exercise.
Here's where the plot thickens: apparently, Hill's paper didn't undergo normal peer review at either journal, and, in particular, was fast-tracked in (papers apparently appear in NYJM as they're submitted, not in annual editions) by an editor that vocally shares Hill's politics. In response, I understand that a significant number of NYJM's peer review board threatened to quit --- an understandable response, since Hill's paper is embarrassing in the context of the rest of what NYJM publishes.
I encourage people with strong opinions who haven't done so already to:
1. Read the current version of Hill's paper.
2. Skim the first version of Hill's paper, which had a coauthor and virtually none of the political content subsequent editions had.
3. Skim subsequent versions and notice how and where they introduced political content, and match that up to the dates Hill suggests the paper was submitted, first to M.I. and then to NYJM.
4. Select a few papers at random from NYJM and skim them quickly to get a sense of the venue Hill is angry he was rejected from.
I'm left with the impression that this was an elaborate troll, one NYJM didn't handle well --- but then, that would be difficult, since its editor in chief is out on leave owing to a grave medical problem.
Later
This has been flagged to the nether regions of the HN story rankings, and justifiably so! It's a political controversy! But it's frustrating that the story introducing Hill's side of this in Quillette was at the top of the front page and accumulated hundreds of comments, while an actually-informed story that critically analyzed the paper itself will get no attention at all. Consider that the next time you think about complaining about people flagging politics off the front page. The Quillette story deserved to be flagged.