Why do you think there were more people who were extremely smart? It does not seem that way to me.

Plus, there is also effect of us glorifying past people more then contemporary people.