The lack of technology. With not much surplus in terms of food and resources children of serfs and peasants have to work and never do much else meanwhile nobles learn to read and educate themselves. And even with reading, without the printing press, all copying was mostly done by the Church, which means no Voltaire, no reading of the Bible to find that indulgences are BS and just a lack of awareness that things could be better.