News for hackers. Stuff that matters.

A comment on Inside The Chaos at OpenAI. Parent comment

Re:Inside The Chaos at OpenAI by cwillu on Sunday November 19, 2023 @10:09PM (#38341796)
Locking in values in that way would be considered a failure of alignment by anyone I've ever read talk about alignment. Not the worst possible failure of alignment (compared to locking in “the value of the entity legally known as OpenAI”, for example), but definitely a straightforward failure to achieve alignment.
[ Parent | on HN ]
Re:Inside The Chaos at OpenAI by archon1410 on Sunday November 19, 2023 @10:26PM (#38341906)
I know it's a theme, MacAskill discusess it in his book. In practice, this is the direction all the "AI safety" departments and organisations seem to be going into.

A world where everyone is paperclipped is probably better than one controlled by psychopathic totalitarian human overlords supported by AI, yet the direction of current research seems to leading us into the latter scenario.

[ Parent | on HN ]
Re:Inside The Chaos at OpenAI by oefnak on Monday November 20, 2023 @09:28PM (#38358193)
Are you serious? Paperclipped means the end of the human race. Why would you prefer that over anything?
[ Parent | on HN ]