I guess that the approach may matter a lot...I worked and paid cash for college (and still am with my graduate degree), so my time has never really been flexible while I'm taking classes.

If I had time now to learn and do whatever I wanted, it'd probably be a huge time of growth with or without college. I guess that combination of taking courses of what you're interested in, and then also being able to study as a hobby, could be really useful.