What if better nutrition has allowed for better selection of taller genes? Back when everyone was more nutrient deficient and had stunted growth, I imagine it would be much harder to select for a suppressed trait.