Personally, I wouldn't change it for the world. Student loans covered the expenses (which as you only pay as a small percentage of your wage above a certain amount and are written off after 30 years if you haven't paid them aren't worth worry about too much), and it had both academic and social benefits. Supervisions often started after 18:00 and occasionally ran on til 23:00, and you could have lectures at 9:00 the next morning, which would be a pain with a commute, and you had easier access to resources (libraries, computing facilities).
I threw myself into the social side, having been fairly reclusive during secondary school - I felt much more comfortable doing so living on site, and I got involved in extra curricular activities I wouldn't have done if I had a commute. I had close friends studying law, natural sciences, economics, engineering, medicine, English, anthropology, and music (I studied computer science), and developed a better understanding of and appreciation for these subjects as a result (I remember discussing Roman law somehow becoming a bizarrely frequent subject in first year). I'm still in almost daily contact with the friendship group I formed there, even ten years on. I did a Master's afterwards, and lived at home, and I never felt as connected to either my studies or my peer group.
Still, I certainly wouldn't call anyone who doesn't do that a coward, and think you could get a similar or better experience living off campus at home. It just turned out to be the right step for me[1] - it pushed me enough out of my comfort zone to grow without leaving me feeling lost - and gave me a much better university experience as a result.
[1] And it was effectively required by my university - you have to live within three miles of the city centre, required permission to live outside of college, and you weren't allowed to keep a car within ten miles of the city centre without permission (https://www.proctors.cam.ac.uk/motor-control)
I don't know when the last time you've lived in dorms was, but they're glorified summer camps for adolescents. Having meal plans and an RA aren't exactly badges of courage.
If you don't come from means or have parents that will help pay for you to move out, then taking on living expenses to study is not exactly a good financial choice.