Unfortunately, there is no funding for such research. Which is find really sad. Private grants might need to show "impact" but State run grants don't have that many constraints, and they could conceivably offer such grants.
I don't think this will work. All it will do is devalue the value of replication studies because only PHD students do replication studies. It's also not in their best interest especially if they dispute findings of established researchers.
Also, we have to get away from the idea that the scientist's job is to think and write, and literally all of the other work can be shuffled off onto low wage (or no wage), low status workers. This is one of the biggest reasons that science is going through such a crisis. If you want enough papers to consistently get grants you probably need at least 4/5 PHD students every few years. This causes a massive glut in the job market. It also dissociates scientists from their work. I've met esteemed computational biologists who could barely work a computer. All of their code was written, run, and analyzed by graduate students or post docs. They were competent enough at statistics, but that level of abstraction from the actual work is troubling.
> All it will do is devalue the value of replication studies because only PHD students do replication studies. It's also not in their best interest especially if they dispute findings of established researchers.
Most studies are done by students regardless, so it seems unlikely that replication studies would be devalued merely because they're done by students. Although disputing the findings of established researchers can be risky, they would be publishing jointly with their PI (or, with the above implementation, multiple PIs), not alone with no support. Few students want to stay in academia, so it usually doesn't matter to them if a professor at some other institution gets offended. Most importantly, if everyone is doing replication studies, there will be so many disputations flying around that any particular person is less likely to be singled out for retaliation.
1. Studies can be much more expensive than most people think. In my field, a moderately sized study can easily cost $100,000+ if you're only accounting for up front cost (e.g. use of equipment, compensating participants). Someone would have to foot the costs of this.
2. Studies can be incredibly labor-intensive. PI's can get away with running studies that require thousands of man-hours because they have a captive market of PHD students, Post-docs, and research assistants all willing to work for low wages or for free. PHD students usually don't have the same amount of man-power.
3. For obvious reasons, studies that require high cost, high man-power work tend to get replicated naturally less. In other words, the least practical studies to replicate happen to also be the most necessary to replicate.
A couple of things I would dispute:
> it seems unlikely that replication studies would be devalued merely because they're done by students
I think academics value work in a particularly skewed way. There is "grant work" and there is "grunt work". Grant work is anything that actively contributes to getting grants for one's institution. Grunt work is everything else. PHD's can do grunt work, but that doesn't mean it will be valued on the job market. For example, software development is actively sought after in (biology) grad students, because it's a very useful skill. However, I've also seen it count against applications as professors because it shows they spent too much time on "grunt work". Software development skills don't win grants.
> Few students want to stay in academia
In some fields there aren't any options except to stay in academia or academia adjacent fields.
> how do differences of culture — however defined — interact with traditional economic mechanisms involving prices, incomes, and simple comparative statics? Are those competing explanations, namely cultural vs. economic?
Richie's answers are mostly focused on changing the culture of science, and while there are lots of ways we could change the incentives, none of them would be pretty.
Example: let's say we want to more closely align research and actionable results, e.g., a product a company can use (Brian Armstrong argues for something like this [1]).
Solution: radically reduce public funding for scientific research and for university education as a whole (in line with Bryan Caplan's arguments in "The Case Against Education" [2]). Academics, who would be many fewer in number, would then have to get more of their funding from companies, who (presumably) would:
A) guide them towards asking market-relevant questions, and
B) have a clear incentive to check the data, re-run the code, etc. -- so that the product they built based on that research didn't flop.
I think most people would recoil at this proposal. But that's what comes to mind when I think about fixing the incentives rather than the culture.
P.S. Small nitpick: Richie gives an _example_ of a perverse incentive in lieu of a definition.
[0] https://marginalrevolution.com/marginalrevolution/2017/01/im...
[1] https://medium.com/@barmstrong/ideas-on-how-to-improve-scien...
[2] https://en.wikipedia.org/wiki/The_Case_Against_Education
Science beholden to business just proves whatever is convenent for business owners not the truth.
Most long-term high impact findings come from foundational research, not applied science.
Also scientists would then just tune their research to sound good to investors.
Tuning economic knobs in an area that should be as free from outside pressure as possible seems counterproductive.
No, being stricter in rewarding rigor over perceived usefulness is the way to go.
Wouldn't that make many scientists (both good and bad) move to other countries where funding is easier to get?
FWIW, and I didn't clarify this enough in my post -- I meant this as an example solution of something that would change the incentives rather than the culture, not necessarily as my own full-throated endorsement; I do personally think that steps in this direction would be for the best, but it's not as though there wouldn't be downsides that would need to be managed/mitigated.
Bit pedantic but you should use they instead of he/she. People can have other pronouns.
When I've talked about this with colleagues, they've argued this would make problems worse, and it might, but I think the idea was more that once you reach a certain threshold you should be funded some amount.
Of course, I'd argue that this is basically the idea behind tenure at an R1 institution, that once you reach a certain level the state or private board of trustees is paying your salary to do research. But nowadays tenure at an R1 institution is proxy for external grant dollars, which defeats the purpose and is redundant.
The real problem is indirect funds, which create profit for institutions. The federal government needs to eliminate indirect funds, so that grant dollars aren't perversely incentivised and tenure is based on research quality rather than profit.
One of those other pronouns is literally "they", so you're still risking using the wrong pronoun by using "they" for someone who prefers to be referred to as "he".
Was anyone else taught the rule that when writing about a third-party whose gender is unknown, use your own pronouns?
On the other hand, if you really think UBI is a good solution, then I'm afraid you don't know how an economy really works.
> On the other hand, if you really think UBI is a good solution, then I'm afraid you don't know how an economy really works.
Could you elaborate more?
Zero Hedge on why UBI doesn't work: https://safehaven.com/markets/economy/Why-Universal-Basic-In...
The Guardian on why UBI doesn't work: https://www.theguardian.com/commentisfree/2019/may/06/univer...
Tenure doesn't really help with this problem in the lab sciences. While it lets faculty members keep their jobs, it usually doesn't come with enough funding to do experimental work. In fact, while you can "keep" a tenured position without grants, many places find ways to...discourage that (move your office to a shoebox in the sub-basement, crappy teaching and service assignments).
Now, I don't have a good solution either, unfortunately. What might work is that we require replication work for a PhD or have a certain percentage of a journal dedicated to verification. That, combined with some meta-studies to reward people with citations for replication, might work without fully swimming against the current.
It's a hard problem, really.