It sounds like you got burnt by being the downsides of being a PM; always having to be somewhat hands-off, too many meetings etc. I would hazard a bet that as lead designer a lot of what you're doing is still PM work; setting the direction, pushing for what gets done and more importantly deciding what to drop.