But isn't the average the useful metric for this question. The question being "If I was born in the 18th century how long would I live". Dying as a baby is a valid outcome.

Maybe the question should be "If I lived past 1 years old what is my average life expectancy?"