With an increasing number of researchers isn't that a great thing? If you publish your little incremental innovations then everyone can build on them. If you try to build your giant all-encompassing framework before you publish any of it, you'll have to do it all yourself (if it even amounts to anything).
Why? Because small incremental improvements cannot get published in high impact journals, and high impact journals are the currency to scientific prestige/grants/tenure.
Then someone (Newton, Darwin, Einstein) comes along and assembles a new framework based on new observations/theories that do a better job of explaining things. Eg the switch from creationism to evolution, or from newtonian physics to relativity.
Here are some more examples:
https://en.wikipedia.org/wiki/Paradigm_shift#Examples_of_par...
I guess what I'm trying to say is that the incentives are strongly biased to what can be easily seen as a increment on what has been done before, and that this is biased against work that may draw on what has been done before but is presenting a fairly different view to what is currently accepted.
Could Darwin have presented his view as an incremental extension of some existing view? (I am aware there were existing theories of evolution, but there weren't any like Darwin's or Wallace's to be built upon).
Einstein didn't get funding, i.e. an academic position. He did his initial groundbreaking work while having a day job in a patent office. He published his four groundbreaking papers in 1905 and was offered a lecturer position only on 1908.
Tenure with reduced teaching responsibilities is the way big thinking gets funded these days.
EDIT: I would also argue that developments like the printing press and the world wide web would have been difficult to justify as incremental extensions of existing work.
I'm not saying these developments came from nowhere, nor that they didn't build on previous work. I'm specifically arguing against the idea that it's fruitful to just focus on work that would be seen as incremental improvements on existing work.
This could be normalized within fields, but in practice it's not. For example, the NIH K-awards have a fixed eligibility period, which seems to keep shrinking.
Source? I'm curious.
http://openaccessweek.org/profiles/blogs/age-amp-science-do-...
"A study in 2002 examined 50 Nobel prize winners from each of the three prizes for physics, chemistry and medicine. This study recorded the age of the scientists when they had done the work that was rewarded with the prize and found that the centre points for age were: physics, 34; chemistry, 37; medicine, 40 (Marchetti C, 2002.) A study published in 1993 investigated a similar data set and concluded that scientists tend to be the most productive in their mid-thirties (Stephan & Levan, 1993.) Finally, a 2008 study of 300 randomly selected bioscientists revealed that the most productive age was 36-40 (Falagas et al., 2008) based on the number of citations from their publications. These studies all indicate that a scientist's greatest potential for discovery is during their thirties"
If instead you measure productivity in number of articles published, this study (http://link.springer.com/article/10.1007%2FBF00142022) claims that productivity peaks at 45-49. However that number covers a wide variety of fields, not just science, and makes no attempt to account for the quality or significance of the work.
Incidentally I remember also reading [1] that in certain fields, in this case mathematics, most of the groundbreaking research comes from younger mathematicians. Great contributions to the field from people over 40 are extremely rare.
[1] Simon Singh, Fermat's Last theorem. Ok, not great source but still!
However, if you forget the job market, the argument the guy is making is absolutely spot on. There's a solid trend in academia that is "publish early, publish fast". Although one might argue that it actually makes sense (career-wise or whatever), it is intrinsic in such a system to penalise pursuing big, risky ideas. Considering that the PhD (and the few years after) are the most productive in a researcher's life, it is a shame that students are not actively encouraged to think bigger.