Because in a world with no privacy, the only people who are going to be squeaky clean are thoae whose lives have been curated from day 1, either through privilege and iron-fisted parent s or through single-mindedness verging on psychosis.
People who should in no way be taking power.
Most countries aside from the USA are pretty blase about their politicians' personal behavior and morality. It's this silly idea that politicians should be paragons of personal virtue, independent of their public and political virtues, that gets the US in such hypocritical binds.
If AI programmers determined the AIs' decisions, that would negate the point of AI.
I can easily write a bunch of code you can't readily predict the outcome to but I can predict with 100% certainty. The easiest way is to cheat and inject code you don't readily see: http://c2.com/cgi/wiki?TheKenThompsonHack
2) ???
3) ???
[...]
3.468^10128) ???
Privacy is a fairly modern invention. I'm not saying you're wrong, but I think it assumes too much to take the concept of sacrosanct privacy as axiomatic.
But, the idea that morality is tied to or because of religion is, erm, pure applesauce. To me, morality appears to be the moving zeitgeist of opinions on what makes a proper society.
At the risk of derailing this topic, the concept we have of privacy as a moral issue is likely to change as well. The common current idea (which I hold as well, please don't misunderstand) is that one's personal privacy, especially as related to communication, is sacrosanct.
But, in a world where it's getting easier and easier to just not give a shit about that and (generally, for 99.9% of the population's personal lives) have no ill effects, people are going to care less and less about data privacy and security, and the zeitgeist will shift.
I think that it will be the defining issue of the 21st century, and I have no idea how things will look coming out the other end.