Re:Stop Explaining Black Box Models for High Stakes Decisions
by mlthoughts2018 on Friday November 01, 2019 @08:47AM
(#21418125)
I think the prevailing political system is intentionally set up so that it is “nobody” or a low-level scapegoat. That’s the whole point of the system. Similar with corporate legal structure, corporate oversight and the way executive actors can avoid personal liability.
My overall point is that “explainability” is inherently subjective & situation-specific and whether a decision process “is explainable” has virtually nothing to do with the concept substrate it is made out of (e.g. “machine learning models” or “military chain of command” or “company policy” or “legal precedent” and so on...).
It’s about who successfully argues for control, nothing more.
Re:Stop Explaining Black Box Models for High Stakes Decisions
by ipsa on Friday November 01, 2019 @09:05AM
(#21418263)
The one who ordered the drone strike is responsible (but hardly held responsible). Easy to draw the parallel with ordering the deployment of anti-personel landmines: the one who ordered deployment is responsible (but may not have signed the treaty, and thus, is hardly held responsible).
Autonomy or explainability is often a red herring. Look at who gives the orders. It is unlikely to ever be the programmer, even if they made a grave mistake. We have a history for that with smart rocket systems.
So who's held responsible in this case? "Nobody" will not be an acceptable answer forever.