AI’s big rift is like a religious schism

Re:AI’s big rift is like a religious schism by greyface- on Tuesday December 12, 2023 @09:56PM (#38622103)

> That entity need not be a single AI. It could be a system like a large corporation

This is not a new problem, then. Let's tackle the issue of corporations, rather than chase an AI boogeyman that doesn't fundamentally change anything.

Look at oil companies, for example. They have humans in the loop at every level, and yet those humans do little to prevent profit incentives from leading them to destroy the planet. A broken reward function is a broken reward function, AI-assisted or not.

[ Parent | on HN ]

Re:AI’s big rift is like a religious schism by staunton on Wednesday December 13, 2023 @03:00AM (#38624047)

An organization's policies are still implemented and maintained by humans. No matter how powerful, the power is transient. You have churn, corruption, incomplete knowledge transfer, etc. AI systems in effective leadership could be able to maintain goals and accumulate power. That's what's new.

[ Parent | on HN ]