Yes, indeed a good CEO has offers from elsewhere. But...why isn't the business and governance open-sourced like the codebase?
Now, is every well paid CEO a truly good leader? No. But I’d argue it’s a lot more difficult to assess a good leader than a good developer. There’s a lot more people management, marketing and other soft skills involved. Not to mention the time scales for success are much larger.
At a decent-sized org it is nearly impossible to measure an individual developer's impact with any granularity.
I think this should also illustrate that evaluating a leader and evaluating a developer are two entirely different things that can't be directly compared anyway.
But over what timescale? For startups especially it is not easy to evaluate a job that involves long term planning in the short term.
Eventually you get CEOs making statements that amount to 'I deliver 10x or 20x more value to this company than you, all my CEO peers say so.'