You should listen to the EconTalk interview with Caplan about the book. He talks about the relative importance of each factor, the uncertainties, and the logic behind it all. He makes quite a compelling case.

https://www.econtalk.org/bryan-caplan-on-the-case-against-ed...