Learning to fly a glider is relatively inexpensive. It's a very different skillset than flying with an engine, but it sounds like a lot of fun. There are glider clubs in many cities where you can learn. I'm hoping to start sometime soon!

http://www.ssa.org/WhatIsSoaring