Did you forget to factor in that it is a replacement rate? Sure, more people are born every year, but plenty of people pass along in one way or another (mortality, downsizing, various care facilities).