When it comes to populations it's about statistics, not about what is possible at all. If we want many great works, we need to make it possible for more people to succeed with that not make it harder. Same fallacy as saying that discrimination or poverty don't impact success, since some people have pulled it off despite those.