>Should those people be punished by being displaced by someone like you who presumably has less expertise due to spending less time on your career

In my experience, the people who have kids generally have more experience because they built up the experience before getting the kids.