You'd have to encode it in the bylaws at the time of incorporation, and then enforce it upon pain of dissolution of the company (so that if a rogue CEO decides they want to stay after all, the rest of the world is like "But now there is no company. Have fun with your paper throne.")

It's a lot like how no ruler will ever abdicate and still remain ruler, so for millenia there was no way to remove a king short of death or coup. We got around that with the invention of the constitution and the definition of a nation-state in terms of that piece of paper, which states that the ruler is defined to have set terms and be subject to an election every so often, and if they don't you get undefined behavior.