No, the AI won't be in charge. It won't set the overall goals. But it will be the truck drivers, the call center workers, the customer service specialists, the personal banking advisers.
When humans are told by the CEO of Wells Fargo, "you need to open 8 new banking accounts per day (because 8 rhymes with great) and we totally don't want you to cram unwanted products into existing customer portfolios, because that would be wrong wink-wink-nudge-nudge", most Wells Fargo employees are going understand what's being said (especially when they are disciplined for not acting illegally), and do the thing that their CEO tells them to do.
An AI given a fitness function to "open the maximum number of accounts, with a minimum probably of being caught performing illegal activity" is going to fuck over banking customers with a far more ruthless efficiency.
Why new companies run by competent people don't displace current companies today?
They have faith that they are doing the right thing. Research tells them they are not, and they either do not care, or, in my opinion, desperately guard their self image as a 'leader' over and above any concern for profit or long-term viability of the business. An AI would be permitted to take a strong role in making decisions for a company only insofar as it plays the role of toady, having been tweaked and misconfigured to ignore all facts which could result in it telling the executives that they are running 'their company' in the wrong way.