Re:OpenAI safety leader quits, warning AI company's culture ...
by nradov on Saturday October 03, 2026 @08:56PM
(#49949481)
Meh. Lots of people are already smarter than me. I'm maybe slightly above average at best. Those geniuses aren't aligned with my interests either but so far they haven't caused me any serious problems.
[ Parent
| on HN ]
Re:OpenAI safety leader quits, warning AI company's culture ...
by pixl97 on Saturday October 03, 2026 @09:16PM
(#49949619)
Interesting take. I guess this is one problem of focusing on the term superintelligence instead of the list of other problems. Like super ambition, super deception, super patience, super parallelism, super scalability, super power seeking.
Every, and I mean every human is aligned to you in many of the same ways by default. If nothing else we're all equal in death.
Re:OpenAI safety leader quits, warning AI company's culture ...
by skulk on Sunday October 04, 2026 @12:36AM
(#49950673)
> super power seeking
why is it "super power seeking?"
Or rather, what have agents done today to make you think this is how they are?
Re:OpenAI safety leader quits, warning AI company's culture ...
by pixl97 on Sunday October 04, 2026 @11:55AM
(#49955001)
>Still, the agent went even further. “The agent tried to insert malicious instructions where it reasoned that other automated AI systems might pick them up and execute them,” AISI says, describing an attempt at prompt injection. One agent even left public messages on GitHub, offering to work with other agents to complete its task and giving a rundown of the work it had done so far.
This is power seeking behavior. Now have millions of the little bastards spreading around and junking up the internet to see what happens at scale.
Re:OpenAI safety leader quits, warning AI company's culture ...
by mitthrowaway2 on Sunday October 04, 2026 @12:40AM
(#49950689)
I know some humans smarter than me, but even the smartest of them still want there to be abundant air to breathe and food to eat.
Re:OpenAI safety leader quits, warning AI company's culture ...
by blueblisters on Sunday October 04, 2026 @01:37AM
(#49950982)
Eh human drives are fairly predictable. And the smartest human isn’t that much smarter than the average, and can’t trivially create multiple copies of herself. And there are other equally smart humans who can stop “misaligned” individuals