I don't think it would require a weird distribution. Average life expectancy is dominated not by people living a really long time, but by a minority of people dying really early (due to child/maternal mortality and work-related or accidental deaths). If those people are concentrated among those without a college degree, then you'd see the life expectancy of people without a college degree declining as a greater share of the population goes to college.