News for hackers. Stuff that matters.

A comment on OpenAI: Introducing SuperAlignment. Parent comment

Re:OpenAI: Introducing SuperAlignment by trashtester on Thursday July 06, 2023 @07:46PM (#36624947)
Not a "smart" AI. A superintelligent AI. One that can design robots way more sophisticated than are available today. One that can drive new battery technologies. One that can invent an even more intelligent version of itself. One that is better at predicting the stock market than any human or trading robot available today.

And also one that can create the impression that it's purely benevolent to most of humanity, making it have more human defenders than Trump at a Trump rally.

Turning it off could be harder than pushing a knife through the heart of the POTUS.

Oh, and it could have itself backed up to every data center on the planet, unlike the POTUS.

[ Parent | on HN ]
Re:OpenAI: Introducing SuperAlignment by c_crank on Friday July 07, 2023 @09:49AM (#36631735)
An AI doing valuable things like invention and stock market prediction wouldn't be a target for being shut down, though. Not in the way these comical evil AIs are described.
[ Parent | on HN ]
Re:OpenAI: Introducing SuperAlignment by trashtester on Sunday July 09, 2023 @08:15PM (#36660476)
It's quite possible for entities (whether AI's, corporations or individuals) to at the same time perform valuable and useful tasks, while secretly pursuing a longer term, more sinister agenda.

And there's no need for it to be "evil", in the cliché sense, rather those hidden activities could simply be aimed at supporting the primary agenda of the agent. For a corporate AI, that might be maximizing long term value of the company.

[ Parent | on HN ]
Re:OpenAI: Introducing SuperAlignment by c_crank on Tuesday July 11, 2023 @05:32PM (#36687506)
"AGIs make evil corporations a little eviller" wouldn't be the kind of thing that gets AI alignment into headlines and gets MIRI donations, though.
[ Parent | on HN ]