If I can give an advice quite different from the other comments: don't sweat it. You're not becoming responsible for the success of your team or your company, you're just taking a different role. Things would probably work fine without you. Hell, companies can run for months and years without CEOs (one of my previous company did).

What you can do is two fold: be technically involved (this is the topic of this thread) and be a good leader. The latter means a lot of things, but IMO it also means transparency. I'm really sad to see other comments saying that your role is to not be transparent, I totally disagree.