if the CTO is inexperienced, you can hire a mentor for the CTO. nominally the CTO still makes the decisions, but can fall back on the mentor for advice.

a good leader also listens to his team and doesn't make decisions against the teams judgement. so it's not always necessary to replace an inexperienced CTO. you can also give the CTO the opportunity to get the experience they need in order to continue.