We haven't formalized ethics to the point of it being a multiplayer puzzle game for adults.

Isn't that what religion in general, and becoming a Doctor of Theology in particular, is?

https://en.wikipedia.org/wiki/Doctor_of_Theology

Quite possibly yes, and I personally grew up in a cult of Bible lawyers so I can imagine it, but here we are talking corporate ethics (an oxymoron) and AI alignment, which are independent of religion.

I mean, personally I see most religious ethics as oxymoronic too, at least in the sense of general ethics that would apply across heterogenous populations. Companies and religions typically have a set of ethics optimized for their best interests.

I suppose it depends on the relative demands of legal vs AI ethics

Well, I guess we have the answer when it comes to Meta.

Legal is a massive bottleneck in many large enterprises.

Unfortunately there’s so much shared legal context between different parts of an enterprise that it’s difficult for each internal organisation to have their own own separate legal resources.

In an ideal world there’d be a lawyer embedded in every product team so that decisions could get made without going to massive committees.