Jail time is not always the entire punishment, especially on the enlightened continent, where jail time is used sparingly. Keeping the conviction on record is a thing, because consecutive convictions often carry come with higher punishment. So depending on a crime cathegory, there is X years after which the record no longer counts, but it's not 0.