Demographics plays a significant role here. In the U.S. women in the middle 3 quintiles of income have fewer children than the top, and far fewer than the bottom. In countries with more generous maternity policies I believe the trend is not as strong.