Well that was my thoughts before I actually did it.. Now that I have the experience, I would say that planning a bit before quitting is important too (that was my failure), also make sure you have sufficiant reserve money to bounce back.

So go do it, but don't jump in with wide-eyed optimism without planning exactly what you want and need to do (but of course be prepared to change the plan)