Actually population growth all over the wold is slowing down. China is already at almost neutral and growth is even slowing in India and Africa.

And a static or shrinking population would have an adverse affect on total market cap, however it would also mean a great job market, because even as the economy shrinks the labor pool would shrink faster.

So your investments would not do well, but you'd always be able to get a high paying job.