We should certainly do something about CEOs being in charge of large multi-billion dollar companies, rarely having direct consequences, and still being rich. It is currently reasonable that a CEO might not know everything when something happens the first time in a huge company. We shouldn't have only one person responsible, but likely a group. This is more important in safety critical industries, but less so for something like a luxury goods company, so you wouldn't want to force every company to this structure.

This is currently an advantageous single point-of-failure for companies and CEOs, and the advantage grows the more safety critical the industry that they're in. The company structure prevents any real responsibility except when the crime is blatant (like the CEO was recorded or wrote down something).