To clarify: it is absolutely necessary, at least for our current toolkit, to rob someones freedom in exchange for the safety of others. But that should come at a very high cost to the punisher: that is society in general as well. Whereas today, it is common to curse someone to "rot in prison" or to suffer torture at the hands of the state, the police or other inmates. That vengeance is not sated because freedom is not valued highly.
US prisons do far more than restrict movement. they infringe on prisoners liberties in dozens of ways unfelated to public safety, from reading material to phone calls to lifestyle within prison and more
I think restricting freedom of movement as punishment is saying that society values law and order (or safety) on equal footing with freedom.
Sure, there are tons of laws that don't make sense and that don't actually make us safer.
But for serious crimes the mechanism of removing your freedom if you remove our safety actually respects freedom as having a lot of value.
And for less serious crimes, you're correct the punishment rarely fits the crime.