If it's a function of a percentile of the population, then sure, there would be fewer geniuses and such. But a shrinking population seems to coincide with a better educated population. An educated, stable, slightly shrinking population can realize its full potential more than a growing population competing for finite resources.