To be fair, for much of history there weren't enough resources for everyone, much less for keeping people fed for free in a prison for decades. For serious crimes you just got executed as soon as possible.