I'm also in the process of writing a few different works (I have one kids sci-fi novel draft finished, and a couple others in various state of progress).
One thing that may help boost your confidence would be joining a writers group. Eg, once a quarter you submit 25k words to the group, and critique each other's works.
I've learned alot doing this, in terms of variety of feedback from different styles of writer. But equally important was seeing other writers' works-in-progress, which was very eye opening, as the first few drafts are always a pale comparison to the finished product.
BTW, your comment that characters take wild turns in ways you did not expect is one of the great joys in writing! I am more of a pantser than plotter myself, and even if I have a vague idea of what will happen in a scene, it's easy for the characters themselves to take control, and very exciting when that happens!
Writers groups are a good idea though, I will have to look for one near me.
I do a lot of beta reading and enjoy it, so could definitely see myself liking being in a writing group.
The only thing for me that is consistently true is needing to know where the story starts and where the story ends. Once I have those two things in mind, everything else comes by actually writing the journey.
I have never been able to successfully outline a complete MS and stick to anything even close. Characters written in real-time do weird things and take wild turns. For me personally it's so important to be flexible with that as to allow my mind space to play.
And maybe I'm weird, but in contrast to Smith's suggestion that once she finishes her draft she's done, I LOVE revising the first (and second, and third) draft of manuscripts. For me, having a messy house to rebuild is so much more fun than micromanaging the story while composing.
Of course I'm also never going to be the same quality of writer as Zadie Smith, so there's that.