You're not alone. I think serious moonlighting is one of the most painful ways to work, bar none. Far more painful than working full-time on any startup.

You're doing a great thing by taking the plunge and going full-time. You just increased your chances by an order of magnitude. Good luck.