nat4ever
In the heat of the moment, what seems like a plausible bargain threatens to reveal grotesque details amid the wreckage.
So, the trolley problem itself usually becomes most interesting when inspecting the identities of any casualties. e.g. What about famous people? What about small children?
In this case, the scenario becomes threatening with the possibility of proving that the condemned was sacrificed only to placate mob rule. e.g. What if the real criminal is found later, somehow?
Acting with a tendency to ignore the postmortem consequences is probably how a machine will operate. They don't have reputation. They don't consult emotion to inform their decisions.
A machine might not question which teddy bear was the most favorite teddy bear, when organizing a garage sale.
Obscurity and inscrutability certainly will never supplant the Objective Ideological Truth that "Security" tries to be, but it's often useful as a source of leverage when all other leverage would be denied to you.
You could never ever claim to endorse obscurity for its own sake during a daily stand-up or a conference call, because people woud rip you to shreds for any number of valid reasons, but when push comes to shove, and you find yourself on the losing side of someone else's moral hazard, being able to throw a smoke screen up, where a brick wall would be preferred, is sometimes all you can do.
An internet that requires devices to be publicly exposed to the entire internet, and directly addressable at all times, is not an internet I want to participate in.
You WILL negotiate a firewall, before learning anything about the devices I use.
ESPECIALLY if I am prevented from knowing their internals, whether by willful disclosure or unlawful reverse engineering.
I control The Spice.
I control the universe.