One thing to consider is population growth was fairly slow overall. Just 5% every 100 years and 2 people grow to ~6.8 billion in 45,000 years and there where far more than 2 people back then.
This surprising reappraisal of American and European physiques is the work of researcher John Komlos of Munich University. 'Much of the difference is due to the great social inequality that now exists in the United States,' Komlos told The Observer last week. 'In Europe, there is - in most countries - good health service provision for most members of society and plenty of protein in most people's diets. As a result, children do not suffer illnesses that would blight their growth or suffer problems of malnutrition. For that reason, we have continued to grow and grow.'
http://econpapers.repec.org/RAS/pko37.htm The height of US-born non-Hispanic children and adolescents ages 2-19, born 1942-2002 in the NHANES Samples
PS: I have wondered if part of the disdain historic rulers had for the lower classes was not just education, but also poor nutrition lowering IQ's. Diet can easily make a 30 point difference in IQ which is huge.
Am I in the middle of a fuck wad nerd debate? I time travel 45,000 years into the past. Will I be able to survive? If not that proves humans were just as smart then as they are now. Where's that pg "Life is Short" article?
I'm not convinced they were starving "cavemen". If they couldn't cut it, Mother Nature would just kill them off - unlike modern, "civilized" people. They had better use of their brains than we do in day-to-day survival.