I would hazard that they are accounted for. People had very many children, only some children survived, some of those reproduced again, I would also guess that the mothers who would die during pregnancy or during childbirth would encounter that at one of the earlier in life pregnancies, and no longer be contributing to the average. I could see all that together supporting the average age of 23.