News for hackers. Stuff that matters.
Re:When Algorithms Rule, Values Can Wither by TeMPOraL on Tuesday December 27, 2022 @11:06PM (#34157432)
> Is this "wiggle room" the fundamental difference between laws and algorithms, so fundamental that we have to fear values withering when algorithms rule, but not when laws rule?

It's more that human values have never been formalized before. It's not clear they can be formalized in a succinct form. This is actually the core problem of AI safety: if (when) we build a human-level-smart general AI, it will have some set of values, but unless those values are perfectly in line with ours, this exercise will most likely turn lethal to humanity.

Or, conversely, it seems that fully specifying what human values are is equivalent to building an aligned, human-level general AI.

Thus, the fundamental difference between laws and algorithms is that laws are executed by humans. The shared value system is implicitly embedded in the system. Even the best algorithms we can come up with today can't replicate that, which means treating their output as binding will result in judgements we'd generally consider immoral, unjust and wrong.

There are no comments on this comment yet.