The problem is formal scholarly training and employment demands are 4-8 years dislocated from each other.

Universities do their best to keep a bead on the market (at least, the good ones do), but without medical school-style coordination it's almost impossible not to under- or over-shoot substantially in terms of graduate supply.