Speak for yourself. I went to college to expand my mind, meet interesting people, and learn things I would never have learned by myself. I am very happy that I did so, even though I barely use any of the actual Physics that I learned, in my daily job.

I will add that I learned far more than just Physics at university. I learned that there were a lot of extremely smart people out there. I learned about my limitations (cramming only gets you so far). I learned about my abilities (few things seem that incredibly hard after a physics degree). I learned how to learn new things (there are many ways to learn). I learned how to behave in a wider variety of environments than I had been exposed to previously. I learned that even amongst very smart people, there were things I could do that no one else could. I learned that if you make the right connections, you can benefit immensely. I learned many more things, far too many to list here.

What went in was a naive, uncouth, slightly ill-mannered boy, what came out was confident, friendly, approachable go-getter.

Perhaps your university didn't expand your mind. If that is so, it is deplorable, but might be the fault of either the university, or yourself. But certainly you should not generalise your unfortunate case and assume that everyone had your poor experience of university.