A simpler explanation: people who spend their 20s in the military or in prison can't attend college until later in life. These are two large populations that are predominantly male and from lower classes.