The winnowing theory only makes sense to people today, because we have such a massive demolition industry. But when things were built with old construction techniques, taking a lot more time and effort, using stone and brick - you built once and it remained long term. The rate of demolition was probably much lower in the past.