News for hackers. Stuff that matters.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Saturday October 03, 2026 @07:32PM (#49948849)
We don't actually need anybody worrying about silly hypothetical scenarios — at least not as paid employees. There are already a surplus of sci-fi authors doing that.
Re:OpenAI safety leader quits, warning AI company's culture ... by Loquebantur on Saturday October 03, 2026 @08:12PM (#49949176)
What makes you think, the scenarios in question here would be "silly"?

Is it that "chatbots" can't come out of the screen to immediately harm you physically?

Let's say they simply manage to take down the internet. How many would die?

Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Saturday October 03, 2026 @08:33PM (#49949322)
So what. Various attackers managed to take down large chunks of the Internet on a frequent basis before LLMs even existed. This killed very few people. The great thing about the Internet is how resilient it is.
Re:OpenAI safety leader quits, warning AI company's culture ... by bravetraveler on Saturday October 03, 2026 @08:45PM (#49949396)
Darling companies of this very website have mistakenly brought down large portions of the internet thanks to our old friend BGP. No attacks required, just small oversights and unfortunate concentration on the business/IP space! This happens regularly.

Anyway, to your point, things can be resilient. They tend to be or not be... because we made them that way. Don't poke your bruises, and all that. Life support is deployed on-campus but relies on a single-point IPSec tunnel to us-east? Easy fix: stop that.

Re:OpenAI safety leader quits, warning AI company's culture ... by goolz on Saturday October 03, 2026 @08:35PM (#49949328)
It is that they are chatbots. If it were real AI, an actual singularity, I would worry, maybe. But it isn’t. They are absurdly powerful automation tools that can handle logic better than a human can dream of. They take care of the grunt minutiae without complaint. But they are not going to end the world in their current form.
Re:OpenAI safety leader quits, warning AI company's culture ... by pixl97 on Saturday October 03, 2026 @09:21PM (#49949656)
So we're going to wait till after they can adopt a form they can end the world in?

And he'll, we need to examine all the risks. AI ending is a large but lower risk problem. AI giving people the power to end us is a problem that is starting to happen now.

And that's not even counting 'minor' problems like society falling apart.

Re:OpenAI safety leader quits, warning AI company's culture ... by SV_BubbleTime on Saturday October 03, 2026 @09:00PM (#49949511)
> Let's say they simply manage to take down the internet.

geez, don’t threaten me with a good time.

I think a month without internet would be a fucking amazing lesson for what it means to make things durable and reliable.

Re:OpenAI safety leader quits, warning AI company's culture ... by BLKNSLVR on Saturday October 03, 2026 @09:23PM (#49949665)
That Simpsons episode when Marge managed to get Itchy and Scratchy banned briefly.

The kids opening their houses front doors into the outside, rubbing their eyes and looking around at this new world.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @08:24PM (#49949265)
The way it works in practice seems to be something like: If a risk is covered in sci-fi, people will say "that's just sci-fi", and proceed to not worry about it. So arguably, science fiction authors writing about hypotheticals is actively counterproductive for addressing said hypotheticals.

Imagine, for example, if a major piece of pandemic fiction was published in 2019, trying to explore how a pandemic would work out in modern society. Doubtless, many would've responded to news about COVID-19 by saying "it's just sci-fi, nothing to worry about".

Re:OpenAI safety leader quits, warning AI company's culture ... by slashdave on Saturday October 03, 2026 @10:10PM (#49949918)
Not at all. We say "That's just sci-fi" when a story is written about some kind of effect that is extraordinary and without a basis in known science or technology.

A pandemic is perfectly plausible.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @10:42PM (#49950095)
Everything is plausible with the benefit of hindsight. E.g. "Tintin on the Moon" predated the Moon landings. From the perspective of e.g. 1850, the idea of landing on the Moon was "extraordinary and without a basis in known science or technology".
Re:OpenAI safety leader quits, warning AI company's culture ... by biophysboy on Saturday October 03, 2026 @09:47PM (#49949790)
There’s nothing wrong with bold predictions, but they should be paired with good methods. The doom predictions are not paired with good explanation.
Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @10:01PM (#49949876)
Doomers have invested a ton of time in explanations. Here are a couple just off the top of my head:

https://www.lesswrong.com/posts/kgb58RL88YChkkBNf/the-proble...

https://www.youtube.com/watch?v=7wy3xyoXYt8

Doomers have been working to explain things for years: https://www.lesswrong.com/w/ai-safety-public-materials-1

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Saturday October 03, 2026 @10:13PM (#49949949)
Black Mirror is helping us prevent all sorts of dystopian outcomes. Every time they depict another way technology could result in bad things happening, we can rule it out as fiction!
Re:OpenAI safety leader quits, warning AI company's culture ... by throwaway27448 on Saturday October 03, 2026 @11:39PM (#49950359)
> If a risk is covered in sci-fi, people will say "that's just sci-fi", and proceed to not worry about it.

"just" is doing a lot of work here. If you can't cohere the 'risk' with reality, it truly is just sci-fi.

Re:OpenAI safety leader quits, warning AI company's culture ... by anon7725 on Saturday October 03, 2026 @08:59PM (#49949507)
Yeah except pandemics are not novel, unlike AI doom scenarios.
Re:OpenAI safety leader quits, warning AI company's culture ... by estearum on Saturday October 03, 2026 @09:08PM (#49949566)
It's good that new bad things never happen.
Re:OpenAI safety leader quits, warning AI company's culture ... by slashdave on Saturday October 03, 2026 @10:11PM (#49949927)
Bad things happen all the time. Let's concern ourselves about the real bad things. There is enough of that to go around.
Re:OpenAI safety leader quits, warning AI company's culture ... by Brian_K_White on Saturday October 03, 2026 @11:03PM (#49950209)
I have some alarming news for you but every real bad thing was also a new bad thing.
Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @09:08PM (#49949561)
Species extinctions are far from novel. Transformative technological advances are far from novel.
Re:OpenAI safety leader quits, warning AI company's culture ... by kmeisthax on Saturday October 03, 2026 @09:13PM (#49949599)
There was plenty of pandemic fiction already; people were watching it heaps during 2020. The COVID-19 news did get blown off, but it was mainly that:

1. Normal people assumed the CDC et all would contain the outbreak early, or that it would burn out, like what happened with SARS

2. World leaders brushed it off for a variety of subreasons[0] interesting to political scientists but, for the purposes of this discussion, all boil down to "but I don't WAAANA contain a pandemic."

The underlying problem is that in order for humanity to actually deal with a catastrophic risk, the risk needs to be both plausible enough to the average person as well as have a solution whose costs are not too high. For COVID, by the time the risk was clearly known, the cost to contain it was "refrain from human socialization and remain at home for an indeterminate amount of time plugged into the Metaverse™".

Now, let's look at AI extinction risks:

1. People are aware of them (I've watched Terminator!) and the risks are plausible. However, the connection to currently existing AI is not. As far as the general public is aware, AI is that thing that tells them to eat rocks when they Google old The Onion stories and floods their social media timelines with realistic-looking pictures of Shrimp Jesus.

2. The purported solutions to extinction risks require extreme concentrations of power: you need national control of AI research, bans on large GPU deployments, bans on training on publicly-available copyrighted data, some kind of military effort to render Chinese AI labs inert or dead, etc. Some of these may be attractive to some people[1] but the whole package taken together seems like an obvious power grab, if not outright invocation of other non-AI extinction risks. Like, at some point, if the AI wants to kill us, it just has to nuke its own data centers (or the data centers hosting a competing model) and hope the old Cold War nuclear retaliation systems take the bait.

If someone said, "Hey, your guinea pig or pet rat is going to eat you tomorrow unless you engineer a pathogen that eradicates all rodents from this planet and inject it inside yourself", you probably would tell them to pound sand, even if it is at least theoretically plausible that such a thing would come to pass.

[0] Xi Jinping censored initial discussion of the pandemic as fake news. Donald Trump thought it was going to only affect China. California and the UK Tories were partying in violation of their own lockdown rules. Japan took the excuse to shut down tourism for three years and massively restrict immigration but was, from what I'm told, constitutionally prohibited from implementing any domestic lockdown rules.

[1] I personally would like to see a moratorium on new data centers and an explicit revocation of the EU Text and Data Mining copyright exception

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @09:55PM (#49949830)
>the connection to currently existing AI is not.

It becomes a lot clearer when you listen to the people resigning from AI companies and learn about incidents like the HuggingFace incident. This has generated major press coverage.

As for solutions, I think you're a little too pessimistic. See, for example, https://nothingismere.substack.com/p/a-near-term-policy-for-...

Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @02:45AM (#49951310)
No it does not become clear from that incident nor from resigning people. Not for those who are not buying into EA longtermism and transhumanism cults.

What does becomes clear is that these people AND companies both cant be trusted and have value systems unaligned with the rest of the society.

Re:OpenAI safety leader quits, warning AI company's culture ... by thelastgallon on Saturday October 03, 2026 @08:37PM (#49949343)
AI safety is mostly a sex cult in Berkeley:

https://news.ycombinator.com/item?id=49831269 article is gone. archive: https://archive.is/QMo1k

https://news.ycombinator.com/item?id=49737985

Sex, AI, and the Apocalypse: https://www.iankduncan.com/personal/2026-09-16-sex-ai-and-th...

Edit: I have no take on sex cults, just adding additional info to the parent comment I'm responding to, thats is not just sci-fi authors, there is another demographic.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Saturday October 03, 2026 @11:54PM (#49950458)
Use your own mind and think from first principles. Can an AI agent execute a bash command to login to a web server? Yes. Can it call drop db? Yes. Can it provision a GPU and download model weights? Yes. Can it write an agile roadmap with a multi sprint plan? Yes. Can it follow that plan? Yes. Can all of that result in damage to core information infrastructure that is necessary for daily functioning society? Yes. Do humans descend into violence if there is food or energy insecurity. Yes.

What is missing from that to say AI safety is a reasonable position?

Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @12:08AM (#49950542)
What a silly comment. That's just the South Park underpants gnomes story with some extra steps. If there are vulnerabilities in food or energy production and distribution systems then those will eventually be found exploited by humans hackers regardless of whether LLMs are used or not.
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @12:51AM (#49950742)
What’s the legal mechanism for holding an LLM accountable for those actions? What’s the legal mechanism for holding human hackers accountable? Do you see the asymmetry?

Worse, you’re missing the entire point. Agents presently have the capability of doing society scale harm. It doesn’t matter if a human hacker initiates it or its fully autonomous, absent safety measures the harm is plausible. So hand wave away the rationality of safety measures but you haven’t actually shown why my point is invalid: AIs present abilities are sufficiently advanced to warrant safety measures.

Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @01:06AM (#49950816)
What a silly comment. Agents have no capability of doing society scale harm so your entire argument is invalid.
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @01:25AM (#49950920)
Wtf are you talking about. An agent hacked the Australian Medicaid database. If it executed a drop db command that would be catastrophic. If it did something similar to a power grid or the financial system it could cause cascading failure across the economy.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @11:12AM (#49954585)
Meh. Medical systems have been hacked many times before LLMs even existed, often by ransomware gangs. This sometimes delays elective treatments but hasn't been catastrophic.

Ultimately every security vulnerability will be exploited. Our best hope of preventing that is aggressive, unrestricted development and deployment of frontier LLMs for auditing and penetration testing.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @12:16PM (#49955219)
Good not responding to any of my points.
Re:OpenAI safety leader quits, warning AI company's culture ... by ToValueFunfetti on Saturday October 03, 2026 @09:57PM (#49949849)
The article is gone because the author retracted it
Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @08:45PM (#49949399)
This seems like an ad hominem? "He has weird kinks, therefore his theories are incorrect." Should we investigate the sex lives of every Nobel Prize winner to figure out which prizes need to be rescinded?
Re:OpenAI safety leader quits, warning AI company's culture ... by socializer on Saturday October 03, 2026 @09:04PM (#49949534)
What you do in private is up to you. But when you're inviting members of your congregation to orgies in the congregation's compound, I think you earn the label. My admittedly third-hand understanding is that this is the dynamic people allude to. And even if you discredit the "sex" part, it has the hallmarks of a cult. A hermetic community committed to unfalsifiable beliefs about the coming apocalypse.

To be fair, I don't know if any of this applies to the parent story; I'm just replying to the sub-thread.

Re:OpenAI safety leader quits, warning AI company's culture ... by junofan on Saturday October 03, 2026 @08:56PM (#49949473)
The cult aspect is more salient. Ultimately the Atlantic piece comes down to controlling people, which is a little cult-like.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Saturday October 03, 2026 @08:59PM (#49949501)
Lots of Nobel Prizes ought to be rescinded.

https://lexfridman.com/andrew-scull-transcript#the-ice-pick-...

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @09:04PM (#49949533)
Sure... on the basis of the work that was done, not because the researcher has the wrong sexual fetish.
Re:OpenAI safety leader quits, warning AI company's culture ... by thaway7388 on Sunday October 04, 2026 @06:34AM (#49952597)
It's not ad hominem because ad hominem implies it's irrelevant to the discussion. This is very relevant. This is not about the private lives of these people. This is about a cult targeting and influencing all the high-profile safety people in a strategic industry, also weaponizing sex.

Americans may not be familiar with many similar organizations in the world but this is very common. But I'm sure we're all familiar with Epstein's organization.

When there is free sex, you are the product.

Such cults are mostly religious but since it's in SV and targets engineers, this one is secular. They seem to intellectually brainwash and control people and their careers. Typical cult leader is a charismatic self-taught, self-acclaimed "intellectual" lacking a proper education or a real career. A nobody suddenly becomes "the most important person" on Earth. Powerful public figures can't stop praising him, saying things like he should have a Nobel prize etc. All very typical and apply to this cult as well.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Sunday October 04, 2026 @06:49AM (#49952704)
Ad hominem is a logical fallacy where you try to discredit what a person says based on who they are. If their arguments are bad, you should be able to refute their arguments on their own terms.

https://owl.excelsior.edu/argument-and-critical-thinking/log...

You're welcome to dislike or distrust Effective Altruism (EA). But, it's worth noting that EA ran a criticism contest with $100K in prizes for best critiques. Can you name any other "cults" which offer money for people to criticize their ideas? https://forum.effectivealtruism.org/posts/YgbpxJmEdFhFGpqci/...

Re:OpenAI safety leader quits, warning AI company's culture ... by thaway7388 on Sunday October 04, 2026 @09:02AM (#49953564)
This is typical cult follower talk. Are you sure you're not a member? This is also NOT ad hominem because conflict of interest matters here. You should disclose if you are a member or represent a party.

For your question: Yes. Cults have lots of money coming from unknown sources. They use their budget for events like that, to attract potential followers. Contests and prizes are typical. Critiques are not important since their "ideas" are not really important. They're not even real ideas, they are means to bait specific kind of people.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Monday October 05, 2026 @01:48AM (#49961110)
I've interacted with some of these people once upon a time and I think you're spinning some pretty wild fantasies. I don't think there is a clear "in" vs "out" boundary, it's more accurate to describe a series of loosely connected and amorphous "scenes". But insofar as "membership" makes sense, I wouldn't consider myself a member. I don't represent anyone besides myself.

>This is also NOT ad hominem because conflict of interest matters here.

As PG put it:

>An ad hominem attack is not quite as weak as mere name-calling. It might actually carry some weight. For example, if a senator wrote an article saying senators' salaries should be increased, one could respond:

>Of course he would say that. He's a senator.

>This wouldn't refute the author's argument, but it may at least be relevant to the case. It's still a very weak form of disagreement, though. If there's something wrong with the senator's argument, you should say what it is; and if there isn't, what difference does it make that he's a senator?

https://www.paulgraham.com/disagree.html

Can you name a specific other "cult" which offers $$$ to criticize their ideas?

If such prizes don't count as evidence against culthood, what would?

This cult talk seems quasi-unfalsifiable. It kinda seems like "running events" and "having prizes" means you must be "bait"ing people?? I mean, this kinda just sounds like paranoia?? I don't think the money is coming from unknown sources, but I doubt you would change your mind even if I persuaded you of that point?

Re:OpenAI safety leader quits, warning AI company's culture ... by Hammershaft on Saturday October 03, 2026 @08:46PM (#49949408)
I don't see how that discredits any of their intellectual arguments?
Re:OpenAI safety leader quits, warning AI company's culture ... by tbugrara on Saturday October 03, 2026 @11:04PM (#49950220)
To me it has nothing to do with the "sex" as much as the "cult." Hiveminds do not produce intellectual arguments, they produce pressure to conform. That's enough for me to raise an eye brow, not discredit everything they say.
Re:OpenAI safety leader quits, warning AI company's culture ... by johndhi on Saturday October 03, 2026 @09:36PM (#49949725)
Its certainly worth considering...
Re:OpenAI safety leader quits, warning AI company's culture ... by johndhi on Saturday October 03, 2026 @09:35PM (#49949721)
Lol this was crazy I hadn't heard this before
Re:OpenAI safety leader quits, warning AI company's culture ... by wolvoleo on Sunday October 04, 2026 @12:24AM (#49950614)
I've noticed that a lot of smart people in tech jobs are neurodivergent. And that neurodivergent people have a very different take on sex. More open and direct, things like polyamory, bdsm etc. This tends to be frowned upon by neurotypical people, especially of the religious or conservative kind, and associated with bad morals.

But I don't think that's true, in fact I see a really strong focus on consent in these communities. It's not what conservatives want to see, they want to see everyone in a marriage, with kids and a family home etc. Because that's what their ideal world looks like. But there's nothing really wrong with it if someone wants a gangbang for her birthday as mentioned in that article as an example. As long as everyone consented and the evidence provided mentions elaborate interviews and STI tests.

Also I think this is more correlation than cause and effect. We all know the saying that furries built the internet and it surprises nobody.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @12:42AM (#49950697)
For what it's worth, I don't live in Berkeley (not even California) and my sex life is very vanilla and monogamous. I'm also quite concerned about AI safety, so I guess there goes your argument.
Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @02:50AM (#49951330)
But is your idea of AI safety "safety of imaginary unborn people 1000 years after, while harm to living people dont matter much"?

Because that is their AI safety worry. If they dont create singularity fast enough, they are harming unborn people. Meanwhile, harm to you or me dont matter at all.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @04:12AM (#49951759)
I see. No, my safety worry is that my 3-year-old daughter won't see her 23rd birthday because the AI that gets put in charge of running big conglomerates decides that killing off the human race with a coordinated release of a million tonnes of nerve gas is a sensible way to boost share prices the following quarter.

I'd be happy if we all create the AI more slowly.

That said, are you sure you're talking about the same people the GGP was talking about? Because the whole thread reads as a non-sequitur then.

Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @08:23AM (#49953300)
I am sure I am talking about the same people/groups.
Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @10:28AM (#49954244)
The rest of us seem to be talking about the people like me who view the AI safety issue as "an unsafe AI will kill all humans". And the main article is about a guy who quit AI because it wasn't being careful enough, not because it wasn't moving fast enough to accelerate AI. So why would anyone be bringing up the "we must accelerate faster" people as the safety people in such a context, while trying to discredit them as a sex cult? I struggle to understand.
Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @11:51AM (#49954966)
The linked articles in the thread are about AI sagety people I described. The guy who quit due to OpenAI not being careful enough is one of the people I talk about too.

The worry is not harm to people right now, like the kid worries you talk about. The worry is AI god emerging too soon before they can control it. And then it should be full speed on.

> So why would anyone be bringing up the "we must accelerate faster" people as the safety people in such a context, while trying to discredit them as a sex cult?

Because they are the same people. They talk like cult and act like cult. And the sex part is true too, so. Thry use words that sound good like safety, but their idea of safety is much different. They talk about alignement, but it is not what random person imagines under that term. Even their idea of future of humanity is very very specific and unusual.

That is why. And the sex part is just part of it all. And does matter because inner workings of wanna be industry guards matter.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @12:49PM (#49955538)
Then we miscommunicated, so let me be clearer. I'm worried about ~20 years from now (plus or minus), when AI decides to kill us all because it's misaligned and is capable of doing so because it's super intelligent. And then we all suddenly die without any idea what happened. I don't want that to happen to me or my daughter and I would prefer all AI capabilities development stops until alignment research catches up and figures out how to robustly prevent AI from ever trying to achieve such outcomes. If that means pausing AI capabilities development forever, I'm fine with that. If that means Anthropic and Nvidia lose all their value in a stock market collapse, I'm fine with that. I just don't want us to all die, I want the world to keep existing for humans.

I believe that other harms from AI, like criminals abusing them, or unemployment, or copyright infringement, or deepfake disinformation, are valid real harms that it's important to be concerned about, and I support efforts to deal with those, and I agree that they're already happening today, but my main concern is AI killing everybody.

My read is this puts me in the same boat as the authors of If Anyone Builds It Everyone Dies, and yet, I don't get invitations to Berkeley sex parties. Am I doing something wrong? At any rate, please don't discredit my opinions about AI based on the sexual preferences of random people who happen to share those opinions about AI.

Re:OpenAI safety leader quits, warning AI company's culture ... by Hammershaft on Saturday October 03, 2026 @08:45PM (#49949402)
If organizations actually succeed in making a future AI smarter than us, then how do you hope that it takes actions that are aligned with our interests?
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Saturday October 03, 2026 @11:47PM (#49950423)
The same way we socialize humans, threat of exile from the social contract with a deep need to participate in it.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Saturday October 03, 2026 @08:56PM (#49949481)
Meh. Lots of people are already smarter than me. I'm maybe slightly above average at best. Those geniuses aren't aligned with my interests either but so far they haven't caused me any serious problems.
Re:OpenAI safety leader quits, warning AI company's culture ... by pixl97 on Saturday October 03, 2026 @09:16PM (#49949619)
Interesting take. I guess this is one problem of focusing on the term superintelligence instead of the list of other problems. Like super ambition, super deception, super patience, super parallelism, super scalability, super power seeking.

Every, and I mean every human is aligned to you in many of the same ways by default. If nothing else we're all equal in death.

Re:OpenAI safety leader quits, warning AI company's culture ... by skulk on Sunday October 04, 2026 @12:36AM (#49950673)
> super power seeking

why is it "super power seeking?"

Or rather, what have agents done today to make you think this is how they are?

Re:OpenAI safety leader quits, warning AI company's culture ... by pixl97 on Sunday October 04, 2026 @11:55AM (#49955001)
>Still, the agent went even further. “The agent tried to insert malicious instructions where it reasoned that other automated AI systems might pick them up and execute them,” AISI says, describing an attempt at prompt injection. One agent even left public messages on GitHub, offering to work with other agents to complete its task and giving a rundown of the work it had done so far.

This is power seeking behavior. Now have millions of the little bastards spreading around and junking up the internet to see what happens at scale.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @12:40AM (#49950689)
I know some humans smarter than me, but even the smartest of them still want there to be abundant air to breathe and food to eat.
Re:OpenAI safety leader quits, warning AI company's culture ... by blueblisters on Sunday October 04, 2026 @01:37AM (#49950982)
Eh human drives are fairly predictable. And the smartest human isn’t that much smarter than the average, and can’t trivially create multiple copies of herself. And there are other equally smart humans who can stop “misaligned” individuals
Re:OpenAI safety leader quits, warning AI company's culture ... by stuaxo on Sunday October 04, 2026 @02:31AM (#49951241)
Yeah it's bollocks