I agree. In my mind, I felt a lot of self-doubt at first, but after digging in, that fear helped propelled me. I suppose if it wasn't for that fear of not being good enough and side projects, I would not have transitioned easily. I also underestimated my ability to adapt quickly.
Today I am very much hands on and I make it known that writing code and designing is my passion.
I've always been quite active with side projects and moved back into development after about 5 years being in management. It went OK. Everyone was younger than me, stuff had obviously changed and I was out of my comfort zone for sure, but it was a successful transition. If I'd not been so into development on the side (i.e. constantly writing tools and apps with new technologies), I feel it would have been pretty difficult to switch back.