Does rational policy immediately change based on the conclusions of this paper? I argue no! Maybe discussions start immediately, confirmation is sought, probably many additional studies with the express intent of confirming the result of the first paper are launched. However, there is no such thing as one paper that needs zero additional support from the community.
As for "additional support from the community" that's not the solution -- it's the problem. Almost by definition, "the community" isn't qualified to support the paper; only to advocate for their preferred actions.
For the second part, they were talking about the scientific community, supporting the paper by reproducing results. Not regular Joes saying "I support this paper" or whatever, if that's what you were thinking.
"However, there is no such thing as one paper that needs zero additional support from the community."
If you meant "scientific community" then I have no issues. I was reacting to all the "The Science is settled!" articles during the pandemic by people from outside it.
Human psychology is a messy business, but when research is conducted earnestly and rigorously according to the scientific method then it is science by definition.
You can find a discipline problematic and unworthy of your interest without actively gatekeeping it, by the way.
Such patronizing. Unworthy of a real scientist.
When their "experiments" generally don't replicate, then it's not a science. Maybe similar to Colbert's word "truthy," what psychologists do is sciencey.
I mean, kind of but not really.
Any academic of even marginal skill can smell a padded CV from a mile away. The type that do this are not serious people and will waste your time and resources. Knowing how to identify an imposter is a survival trait.
Usually the type to pad a CV with garbage are eyeing admin or corporate gigs, not academic success. A search committee or tenure committee wouldn't look too kindly at a bunch of wacky papers in the east austrian journal of ass-scratch.
Yes there is huge demand to be published, but quality matters a lot if you intend to seriously participate in the scientific community.
A couple drops of "Eau de Népotisme" and the smell goes away miraculously. Torturing your job requisites so only the desired local candidate can apply is a way to "solve" it.
For example, in Germany it is extremely rare to become a professor at the. University where you did your phd/postdoc. It's almost always seen a something not quite right.
Now there is still lots of politics involved in the hiring process. Tenured positions are rare and often the other academics on the committee want to candidates which strengthen their own research area (although interestingly if there is a colleague down the corridor or someone at a university half way around the world who can do some technique you require, collaboration is much more likely to happen with the external person)
“It survived because it was something that only academics cared about”
The critical change has been in the number of academics, not in their level of care. It was always a small exclusive group. It can only work if it’s a small exclusive group. We can’t make everyone an academic and expect quality output anymore than we can make everyone a coder and expect great software. Academia (higher ed) simply cannot scale and still be what it’s been. Great wine must be produced in small batches, perhaps the elite should be too.
The "solution" which occurs almost immediately to any developer is to automate the reputation, but I think we've seen enough SEO and similar algorithm-hacking to understand how that fails. In fact, "rack up a lot of publications" is itself a method of hacking an attempt at automating reputation.
So why now?
> Jack Ben, of a firm whose Chinese name translates to Olive Academic
> researcher and assistant professor in Saudi Arabia, Malaysia, and Jordan.
> the company acts as a broker, sharing payments from the paper mills with multiple editors—including Omar Cheikhrouhou of Taif University in Saudi Arabia and the University of Sfax in Tunisia.
> A Ukrainian paper mill dubbed Tanu.pro
> While he was visiting his parents in India last summer, a Dr. Sarath of iTrilon reached out to him on WhatsApp, offering authorship of “readymade papers” with “100% Acceptance Guarantee.”
> in Russia and several ex-Soviet countries, for example, policies focused on publication metrics, coupled with a culture of corruption and the transition to market economy
This culture is slowly corrupting scientific journaling itself as an undertaking, firstly because established journals will end up employing some of these people (as in the article), but more importantly because as mentioned, it's a culture problem and who doesn't want easy money and guaranteed quid-pro-quo publication when all your friends are doing it? After all, you're not a bad person and I'm sure your science is fine.
But it's not based on metrics. Those are only used as an initial filter. When it comes to important decisions, the reputable parts of the academia rely on peer review. Shortlisted candidates – if not everyone - are evaluated by people who are expected to understand the research itself. Final evaluations are based on subjective judgment rather than objective metrics. It's not a perfect system, but it works reasonably well as long as most of the reputable experts deserve their reputation.
> It's not a perfect system, but it works reasonably well as long as most of the reputable experts deserve their reputation.
I don't understand why you'd think this is a reasonable expectation. There's plenty of public examples where assumed competency turns out to be a costly, or even fatal mistake. That's just what's documented. Underneath, especially in academia, there's many examples of grifters in high positions. Every grad student (that is 100%) I've talked to has a story about this.
There is a good side to the academia, but you are less likely to experience it if you get into politics. Caring about frauds, grifters, and plagiarism is politics. You should make a conscious choice: do you care more about science as an ideal or about your own research. If you focus on your own research, you can seek like-minded people and ignore those who pursue status.
Of course, the academia is a risky career choice, and success is far from guaranteed. That's why it's important to know when to let go. You should learn to estimate what kind of career success you can expect, without wasting too many years in the process. Once you know that, you can determine if you would be content with that for the rest of your career, and make the choices accordingly.
What matters is a culture of honesty. If a part of the academia has it, it probably produces long-term value. Unfortunately a culture is a nebulous idea. You can't measure it, and you can't really evaluate it from the outside. You may see it after the fact, if some people produced good science, because they lived in a culture that encouraged it.
Professional reputation is a signal for insiders. It can be used as a proxy for determining if someone is worth working with and if they are a good cultural fit. It's less useful for administrators, but they are not the ones doing science.
* I want to be clear that I’m very much in favor of science-based policy, but giving The Science credit and blame is not a tenable path forward, because science is hard and there will be mistakes. The way to do it is to have public figures analyze where the field is and stake their professional reputations on interpreting it correctly. Individual professional reputation is the load bearing structure of a serious society.