That's going to vary person to person I bet. Even if I had the time there's no way I could work out in my 40s now as much as I did and with the same intensity as my 20s, my body just won't take it and I need more recovery.

Oh definitely. Maybe I'm overly optimistic, but I think you can be in like the top 20% of physical fitness by just consistently moving and lifting weights.