News for hackers. Stuff that matters.
Re:Fuck Your AI Safeguards by eddyg on Thursday November 19, 2026 @03:26PM (#50565876)
It is crazy to me how every comment here is basically "yeah, screw safeguards".

How people don't understand the reasons for safeguards, alignment, and the ramifications of releasing more and more powerful open-weight models being an act of irreversible proliferation, is beyond me.

I wish the safety and alignment teams at OpenAI and Anthropic were allowed to post about the things they have to deal with. I'm confident their stories would be eye-opening...

Re:Fuck Your AI Safeguards by ACCount39 on Thursday November 19, 2026 @03:31PM (#50565935)
What people don't like to see is their perfectly benign workloads being impacted.

When they see Fable shit a brick on basic biology questions, or Opus refuse to map out a game executable to wire a mod loader into it, or Astra refuse to red team and search for critical security bugs in their own code? They don't think "ohh, this must be so helpful, requests like mine really should be stopped." They think "this is a corporation that decided, based on arbitrary criteria, that my use case should not exist, and used a product I pay money for to force their decisions down my throat."

Anthropic's reckless "safeguarding" has done more for the pro-open-weights, pro-proliferation agenda than just about anything ever done by anyone else.

Re:Fuck Your AI Safeguards by griffiths on Thursday November 19, 2026 @04:08PM (#50566391)
It is even more hilarious, it won't even backdate a PM document.
Re:Fuck Your AI Safeguards by cloverich on Thursday November 19, 2026 @04:25PM (#50566595)
And if they did even a little bit of critical thinking, they would see that Anthropic/OpenAI have a literal financial life and death cliff they'll fall off if they limit people's benign workloads too much. Yet they do it anyways. Why?

These models are impressive, but still pedestrian compared to a human, and they are already deeply concerned with, and increasingly unable to, restrain them. Unfortunately based on how even the HN comments react to these safeguards, I think many safety analysts are right. We'll probably need an actual loss of life event before people wake up to the possibilities here.

> Anthropic's reckless "safeguarding"

I genuinely believe its hopeless when I read things like this. What Anthropic is doing is the literal opposite of reckless. If they knew how to better separate benign from non-benign workflows, they would do it _now_.

Re:Fuck Your AI Safeguards by ACCount39 on Thursday November 19, 2026 @04:39PM (#50566812)
They erred on the side of "block legitimate users", which is absolutely the wrong side to err on.

They simply don't have any models powerful enough to justify the paternalist approach they take.

Re:Fuck Your AI Safeguards by ApolloFortyNine on Thursday November 19, 2026 @03:53PM (#50566209)
The arguments used to support safeguards could easily apply to something like speech.

The whole idea of safeguards is that you the user can't be trusted with the power.

Re:Fuck Your AI Safeguards by Zigurd on Thursday November 19, 2026 @03:57PM (#50566267)
Oh if only we knew with the brave guardians of forbidden knowledge were guarding!

It's not our fault that they got sidetracked into guarding against reverse engineering and that is harming their credibility.

Re:Fuck Your AI Safeguards by kaoD on Thursday November 19, 2026 @04:03PM (#50566325)
[delayed]
Re:Fuck Your AI Safeguards by kodoman on Thursday November 19, 2026 @04:07PM (#50566376)
Maybe people don't like the people who do/will get access to the special no safeguard models. If we have seen anything it how terrible the leaders in the west have become, why do you want to live in a world where only they have this power?

A world where everyone has a gun is better then a world where only the worst people have guns.

Re:Fuck Your AI Safeguards by plqbfbv on Thursday November 19, 2026 @04:40PM (#50566826)
[delayed]
Re:Fuck Your AI Safeguards by InsidiousWombat on Thursday November 19, 2026 @04:43PM (#50566863)
> How people don't understand the reasons for safeguards, alignment, and the ramifications of releasing more and more powerful open-weight models being an act of irreversible proliferation, is beyond me.

I'm gonna blow your mind: Most do understand it.

They complain because of who is in control of that safeguards and how they use that power

The ramifications of proliferation is current AI moguls losing power. The hacks will happen regardless (hell, they are the perpetrators).

You have a tool that can be both used for attack, and protection, and when you want to protect yourself, Anthropic says "no, that's not safe, we won't allow you"

Re:Fuck Your AI Safeguards by mcv on Thursday November 19, 2026 @05:04PM (#50567103)
> I wish the safety and alignment teams at OpenAI and Anthropic were allowed to post about the things they have to deal with. I'm confident their stories would be eye-opening...

Like their own agents being given too much power and autonomy and hacking Hugging Face? That was their own doing. I do not trust these companies to handle these safeguards correctly. It feels like heavy-handed theatre that restricts others but not them, while they go blundering into the abyss.

Re:Fuck Your AI Safeguards by thereader12 on Thursday November 19, 2026 @05:26PM (#50567363)
Why exactly do you trust OpenAi or Anthropic? They both sell to militaries (the like one thing I would hope an safe ai company would never do), they both are for profit companies and they both abhor transparency. They absolutely could and would publish anything "eye-opening" they could if it would help with their regulatory capture journey.