I think I have similar feelings. While studying and in my early 20s I spent a lot of time trying to build a side business (a la Four Hour Work Week) so I could have freedom to spend my life how I wanted instead of working all the time.

My parents were not very well off and I had to work a couple of jobs to put myself through higher education, so I think this is where that came from. The ironic thing was that in that part of my life I had basically no responsibility so could have actually lived my life and don't whatever I wanted, I just didn't have much money.

Now I'm in my 30s, have a family, and have a ton of responsibilities. I'm doing somewhat well financially (money in > money out), but now have no free time to actually do anything, and not enough savings to take an extended break from working.