I had an enlightenment about a year ago and realized that being well-rounded is supremely important. As a citizen of the world I ought to understand more than the basics of economics, philosophy, biology, art, history, music, etc. On one hand, it allows you to appreciate all the hard work that other people do in these subjects. On the other hand, this knowledge helps you make educated decisions when your democracy presents them to you. It's not stupidity that hurts us as a society, its lack of knowledge. An easy way to get knowledge is at a University.
Personal enlightenment and politics aside, conversing with well rounded people is more satisfying for both parties because a well-rounded individual often can offer a more sophisticated and interesting opinion than someone with little background and little ability to make connections between disparate fields. Alan Kay commented on combining orthogonal knowledge in his OOPSLA keynote[1].
[1] http://video.google.com/videoplay?docid=-2950949730059754521
I started as a freshman this week at 34 years old. It's only a community college but after 30 graded credit hours most universities will disregard my high school transcript and grant admission.
It's never too late to go back. Especially if you're single and have an understanding employer.
Learning to perform a technical skill is far more achievable on ones own than discussion, communication, and analysis of, say, history or philosophy, which is most easily practiced in the company of others performing the same task.
College is not solely about the raw skills used in your trade. It is also about exposure to several topics intended to round out the character of an individual.
If your good at hacking, maybe you could skip college entirely. But your also increasing your chances of being profoundly naive in life.