News for hackers. Stuff that matters.
Re:OpenAI safety leader quits, warning AI company's culture ... by thelastgallon on Saturday October 03, 2026 @08:37PM (#49949343)
AI safety is mostly a sex cult in Berkeley:

https://news.ycombinator.com/item?id=49831269 article is gone. archive: https://archive.is/QMo1k

https://news.ycombinator.com/item?id=49737985

Sex, AI, and the Apocalypse: https://www.iankduncan.com/personal/2026-09-16-sex-ai-and-th...

Edit: I have no take on sex cults, just adding additional info to the parent comment I'm responding to, thats is not just sci-fi authors, there is another demographic.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Saturday October 03, 2026 @11:54PM (#49950458)
Use your own mind and think from first principles. Can an AI agent execute a bash command to login to a web server? Yes. Can it call drop db? Yes. Can it provision a GPU and download model weights? Yes. Can it write an agile roadmap with a multi sprint plan? Yes. Can it follow that plan? Yes. Can all of that result in damage to core information infrastructure that is necessary for daily functioning society? Yes. Do humans descend into violence if there is food or energy insecurity. Yes.

What is missing from that to say AI safety is a reasonable position?

Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @12:08AM (#49950542)
What a silly comment. That's just the South Park underpants gnomes story with some extra steps. If there are vulnerabilities in food or energy production and distribution systems then those will eventually be found exploited by humans hackers regardless of whether LLMs are used or not.
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @12:51AM (#49950742)
What’s the legal mechanism for holding an LLM accountable for those actions? What’s the legal mechanism for holding human hackers accountable? Do you see the asymmetry?

Worse, you’re missing the entire point. Agents presently have the capability of doing society scale harm. It doesn’t matter if a human hacker initiates it or its fully autonomous, absent safety measures the harm is plausible. So hand wave away the rationality of safety measures but you haven’t actually shown why my point is invalid: AIs present abilities are sufficiently advanced to warrant safety measures.

Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @01:06AM (#49950816)
What a silly comment. Agents have no capability of doing society scale harm so your entire argument is invalid.
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @01:25AM (#49950920)
Wtf are you talking about. An agent hacked the Australian Medicaid database. If it executed a drop db command that would be catastrophic. If it did something similar to a power grid or the financial system it could cause cascading failure across the economy.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Sunday October 04, 2026 @11:12AM (#49954585)
Meh. Medical systems have been hacked many times before LLMs even existed, often by ransomware gangs. This sometimes delays elective treatments but hasn't been catastrophic.

Ultimately every security vulnerability will be exploited. Our best hope of preventing that is aggressive, unrestricted development and deployment of frontier LLMs for auditing and penetration testing.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @12:16PM (#49955219)
Good not responding to any of my points.
Re:OpenAI safety leader quits, warning AI company's culture ... by ToValueFunfetti on Saturday October 03, 2026 @09:57PM (#49949849)
The article is gone because the author retracted it
Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @08:45PM (#49949399)
This seems like an ad hominem? "He has weird kinks, therefore his theories are incorrect." Should we investigate the sex lives of every Nobel Prize winner to figure out which prizes need to be rescinded?
Re:OpenAI safety leader quits, warning AI company's culture ... by socializer on Saturday October 03, 2026 @09:04PM (#49949534)
What you do in private is up to you. But when you're inviting members of your congregation to orgies in the congregation's compound, I think you earn the label. My admittedly third-hand understanding is that this is the dynamic people allude to. And even if you discredit the "sex" part, it has the hallmarks of a cult. A hermetic community committed to unfalsifiable beliefs about the coming apocalypse.

To be fair, I don't know if any of this applies to the parent story; I'm just replying to the sub-thread.

Re:OpenAI safety leader quits, warning AI company's culture ... by junofan on Saturday October 03, 2026 @08:56PM (#49949473)
The cult aspect is more salient. Ultimately the Atlantic piece comes down to controlling people, which is a little cult-like.
Re:OpenAI safety leader quits, warning AI company's culture ... by nradov on Saturday October 03, 2026 @08:59PM (#49949501)
Lots of Nobel Prizes ought to be rescinded.

https://lexfridman.com/andrew-scull-transcript#the-ice-pick-...

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Saturday October 03, 2026 @09:04PM (#49949533)
Sure... on the basis of the work that was done, not because the researcher has the wrong sexual fetish.
Re:OpenAI safety leader quits, warning AI company's culture ... by thaway7388 on Sunday October 04, 2026 @06:34AM (#49952597)
It's not ad hominem because ad hominem implies it's irrelevant to the discussion. This is very relevant. This is not about the private lives of these people. This is about a cult targeting and influencing all the high-profile safety people in a strategic industry, also weaponizing sex.

Americans may not be familiar with many similar organizations in the world but this is very common. But I'm sure we're all familiar with Epstein's organization.

When there is free sex, you are the product.

Such cults are mostly religious but since it's in SV and targets engineers, this one is secular. They seem to intellectually brainwash and control people and their careers. Typical cult leader is a charismatic self-taught, self-acclaimed "intellectual" lacking a proper education or a real career. A nobody suddenly becomes "the most important person" on Earth. Powerful public figures can't stop praising him, saying things like he should have a Nobel prize etc. All very typical and apply to this cult as well.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Sunday October 04, 2026 @06:49AM (#49952704)
Ad hominem is a logical fallacy where you try to discredit what a person says based on who they are. If their arguments are bad, you should be able to refute their arguments on their own terms.

https://owl.excelsior.edu/argument-and-critical-thinking/log...

You're welcome to dislike or distrust Effective Altruism (EA). But, it's worth noting that EA ran a criticism contest with $100K in prizes for best critiques. Can you name any other "cults" which offer money for people to criticize their ideas? https://forum.effectivealtruism.org/posts/YgbpxJmEdFhFGpqci/...

Re:OpenAI safety leader quits, warning AI company's culture ... by thaway7388 on Sunday October 04, 2026 @09:02AM (#49953564)
This is typical cult follower talk. Are you sure you're not a member? This is also NOT ad hominem because conflict of interest matters here. You should disclose if you are a member or represent a party.

For your question: Yes. Cults have lots of money coming from unknown sources. They use their budget for events like that, to attract potential followers. Contests and prizes are typical. Critiques are not important since their "ideas" are not really important. They're not even real ideas, they are means to bait specific kind of people.

Re:OpenAI safety leader quits, warning AI company's culture ... by 0xDEAFBEAD on Monday October 05, 2026 @01:48AM (#49961110)
I've interacted with some of these people once upon a time and I think you're spinning some pretty wild fantasies. I don't think there is a clear "in" vs "out" boundary, it's more accurate to describe a series of loosely connected and amorphous "scenes". But insofar as "membership" makes sense, I wouldn't consider myself a member. I don't represent anyone besides myself.

>This is also NOT ad hominem because conflict of interest matters here.

As PG put it:

>An ad hominem attack is not quite as weak as mere name-calling. It might actually carry some weight. For example, if a senator wrote an article saying senators' salaries should be increased, one could respond:

>Of course he would say that. He's a senator.

>This wouldn't refute the author's argument, but it may at least be relevant to the case. It's still a very weak form of disagreement, though. If there's something wrong with the senator's argument, you should say what it is; and if there isn't, what difference does it make that he's a senator?

https://www.paulgraham.com/disagree.html

Can you name a specific other "cult" which offers $$$ to criticize their ideas?

If such prizes don't count as evidence against culthood, what would?

This cult talk seems quasi-unfalsifiable. It kinda seems like "running events" and "having prizes" means you must be "bait"ing people?? I mean, this kinda just sounds like paranoia?? I don't think the money is coming from unknown sources, but I doubt you would change your mind even if I persuaded you of that point?

Re:OpenAI safety leader quits, warning AI company's culture ... by Hammershaft on Saturday October 03, 2026 @08:46PM (#49949408)
I don't see how that discredits any of their intellectual arguments?
Re:OpenAI safety leader quits, warning AI company's culture ... by tbugrara on Saturday October 03, 2026 @11:04PM (#49950220)
To me it has nothing to do with the "sex" as much as the "cult." Hiveminds do not produce intellectual arguments, they produce pressure to conform. That's enough for me to raise an eye brow, not discredit everything they say.
Re:OpenAI safety leader quits, warning AI company's culture ... by johndhi on Saturday October 03, 2026 @09:36PM (#49949725)
Its certainly worth considering...
Re:OpenAI safety leader quits, warning AI company's culture ... by johndhi on Saturday October 03, 2026 @09:35PM (#49949721)
Lol this was crazy I hadn't heard this before
Re:OpenAI safety leader quits, warning AI company's culture ... by wolvoleo on Sunday October 04, 2026 @12:24AM (#49950614)
I've noticed that a lot of smart people in tech jobs are neurodivergent. And that neurodivergent people have a very different take on sex. More open and direct, things like polyamory, bdsm etc. This tends to be frowned upon by neurotypical people, especially of the religious or conservative kind, and associated with bad morals.

But I don't think that's true, in fact I see a really strong focus on consent in these communities. It's not what conservatives want to see, they want to see everyone in a marriage, with kids and a family home etc. Because that's what their ideal world looks like. But there's nothing really wrong with it if someone wants a gangbang for her birthday as mentioned in that article as an example. As long as everyone consented and the evidence provided mentions elaborate interviews and STI tests.

Also I think this is more correlation than cause and effect. We all know the saying that furries built the internet and it surprises nobody.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @12:42AM (#49950697)
For what it's worth, I don't live in Berkeley (not even California) and my sex life is very vanilla and monogamous. I'm also quite concerned about AI safety, so I guess there goes your argument.
Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @02:50AM (#49951330)
But is your idea of AI safety "safety of imaginary unborn people 1000 years after, while harm to living people dont matter much"?

Because that is their AI safety worry. If they dont create singularity fast enough, they are harming unborn people. Meanwhile, harm to you or me dont matter at all.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @04:12AM (#49951759)
I see. No, my safety worry is that my 3-year-old daughter won't see her 23rd birthday because the AI that gets put in charge of running big conglomerates decides that killing off the human race with a coordinated release of a million tonnes of nerve gas is a sensible way to boost share prices the following quarter.

I'd be happy if we all create the AI more slowly.

That said, are you sure you're talking about the same people the GGP was talking about? Because the whole thread reads as a non-sequitur then.

Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @08:23AM (#49953300)
I am sure I am talking about the same people/groups.
Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @10:28AM (#49954244)
The rest of us seem to be talking about the people like me who view the AI safety issue as "an unsafe AI will kill all humans". And the main article is about a guy who quit AI because it wasn't being careful enough, not because it wasn't moving fast enough to accelerate AI. So why would anyone be bringing up the "we must accelerate faster" people as the safety people in such a context, while trying to discredit them as a sex cult? I struggle to understand.
Re:OpenAI safety leader quits, warning AI company's culture ... by watwut on Sunday October 04, 2026 @11:51AM (#49954966)
The linked articles in the thread are about AI sagety people I described. The guy who quit due to OpenAI not being careful enough is one of the people I talk about too.

The worry is not harm to people right now, like the kid worries you talk about. The worry is AI god emerging too soon before they can control it. And then it should be full speed on.

> So why would anyone be bringing up the "we must accelerate faster" people as the safety people in such a context, while trying to discredit them as a sex cult?

Because they are the same people. They talk like cult and act like cult. And the sex part is true too, so. Thry use words that sound good like safety, but their idea of safety is much different. They talk about alignement, but it is not what random person imagines under that term. Even their idea of future of humanity is very very specific and unusual.

That is why. And the sex part is just part of it all. And does matter because inner workings of wanna be industry guards matter.

Re:OpenAI safety leader quits, warning AI company's culture ... by mitthrowaway2 on Sunday October 04, 2026 @12:49PM (#49955538)
Then we miscommunicated, so let me be clearer. I'm worried about ~20 years from now (plus or minus), when AI decides to kill us all because it's misaligned and is capable of doing so because it's super intelligent. And then we all suddenly die without any idea what happened. I don't want that to happen to me or my daughter and I would prefer all AI capabilities development stops until alignment research catches up and figures out how to robustly prevent AI from ever trying to achieve such outcomes. If that means pausing AI capabilities development forever, I'm fine with that. If that means Anthropic and Nvidia lose all their value in a stock market collapse, I'm fine with that. I just don't want us to all die, I want the world to keep existing for humans.

I believe that other harms from AI, like criminals abusing them, or unemployment, or copyright infringement, or deepfake disinformation, are valid real harms that it's important to be concerned about, and I support efforts to deal with those, and I agree that they're already happening today, but my main concern is AI killing everybody.

My read is this puts me in the same boat as the authors of If Anyone Builds It Everyone Dies, and yet, I don't get invitations to Berkeley sex parties. Am I doing something wrong? At any rate, please don't discredit my opinions about AI based on the sexual preferences of random people who happen to share those opinions about AI.