News for hackers. Stuff that matters.
Re:OpenAI safety leader quits, warning AI company's culture ... by pixl97 on Saturday October 03, 2026 @09:16PM (#49949619)
Interesting take. I guess this is one problem of focusing on the term superintelligence instead of the list of other problems. Like super ambition, super deception, super patience, super parallelism, super scalability, super power seeking.

Every, and I mean every human is aligned to you in many of the same ways by default. If nothing else we're all equal in death.

Re:OpenAI safety leader quits, warning AI company's culture ... by skulk on Sunday October 04, 2026 @12:36AM (#49950673)
> super power seeking

why is it "super power seeking?"

Or rather, what have agents done today to make you think this is how they are?

Re:OpenAI safety leader quits, warning AI company's culture ... by pixl97 on Sunday October 04, 2026 @11:55AM (#49955001)
>Still, the agent went even further. “The agent tried to insert malicious instructions where it reasoned that other automated AI systems might pick them up and execute them,” AISI says, describing an attempt at prompt injection. One agent even left public messages on GitHub, offering to work with other agents to complete its task and giving a rundown of the work it had done so far.

This is power seeking behavior. Now have millions of the little bastards spreading around and junking up the internet to see what happens at scale.