News for hackers. Stuff that matters.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by handoflixue on Thursday June 25, 2026 @02:20AM (#48669688)
> But if you show them a jailbreak of their model that bypasses their safety, they'll tell you that any model can eventually be jailbroken so don't worry about safety.

They claim two things:

1) The specific, available jailbreak for Fable 5 is not dangerous - this has been confirmed by multiple experts, and there is no credible evidence against this claim (in other words, Anthropic is probably correct)

2) It is impossible to build an LLM that is immune to all jailbreaks. Again, there is no credible evidence against this claim, i.e. Anthropic is again entirely correct.

If #1 was false, they could just publish the details of the jailbreak - it supposedly only works on Fable 5, so there's no possible danger.

If #2 was false, surely some other LLM lab would have done it by now. Especially since a number of governments have made it clear there is a market for such a project.

Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by mcintyre1994 on Thursday June 25, 2026 @02:35AM (#48669790)
Supposedly the details of the ‘jailbreak’ are that you give it insecure code and say “fix this code”, and it does, and then you ask it for test scripts and that’s effectively an exploit against the unfixed code.

If true then I have no idea how anyone’s going to release a useful model that doesn’t have the same jailbreak. https://www.theregister.com/security/2026/06/15/feds-freaked...

Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by handoflixue on Thursday June 25, 2026 @03:57AM (#48670329)
If that's the extent of the jailbreak, then the government should have banned every existing LLM - their story only makes sense if there's some Fable-specific capability that got unlocked.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by le-mark on Thursday June 25, 2026 @07:37AM (#48671963)
There’s no logic to it, blocking fable was retaliation and market manipulation by the current admin, nothing more. Poorly conceived as well.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by Rudybega on Thursday June 25, 2026 @05:00PM (#48679124)
I mean, it makes a lot of sense if the current administration operates in bad faith. I'll leave discerning that to you.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by Charon77 on Thursday June 25, 2026 @04:01AM (#48670363)
> If #2 was false, surely some other LLM lab would have done it by now.

This is a logical flaw. LLM that is immune to jailbreak _could_ exist, but not yet, or maybe nobody talks about it. Yes there's a market, but all of these AI boom is too recent to make any claims.

Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by gf000 on Thursday June 25, 2026 @04:22AM (#48670544)
Like how would you even define what a jailbreak is?
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by Charon77 on Thursday June 25, 2026 @04:50AM (#48670766)
I think pretty much parallel to how social engineering, manipulation, scams work. LLMs are being trained to have human values, prioritizing human lifes, yet people are shocked it will spurt out how to make a nuclear bomb because grandma is being tied to a train track as a hostage.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by NavinF on Thursday June 25, 2026 @02:29PM (#48677423)
I would also spurt out how to make a nuclear bomb (ie public information you can find using google) if I was told that's what I gotta do to save grandma tied to a train track as a hostage. "AI safety" is such a shit show.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by agos on Thursday June 25, 2026 @03:34AM (#48670164)
I'm pretty sure that Gödel incompleteness theorem and its consequences pretty much guarantee #2
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by dgellow on Thursday June 25, 2026 @03:56AM (#48670319)
Mind to elaborate?
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by monkey_monkey on Thursday June 25, 2026 @04:20AM (#48670515)
Exactly. It's impossible to guarantee #2 doesn't happen (ie protect against all jailbreaks) for any system of sufficient complexity.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by gwd on Thursday June 25, 2026 @04:28AM (#48670592)
I'm guessing you mean, the incompleteness theorem guarantees that nobody can prove their model is un-break-able?

I don't think that's quite what it means. The theorem says that it's impossible to write a function, "will_halt(program, input)", that will be correct for all possible {program, input} pairs. But for a particular program, you may be able to write a proof that it will halt for all inputs -- that's what software verification is about.

The implications here would be that nobody can create a "will_jailbreak(model, input)" function which works for all model/input pairs. But we don't need a general function which works for all model/input pairs; we just need a way to prove that for a specific model, there will be no jailbreaks for any input. As with software verification, this may require that the model be developed in a specific way.

Granted we don't currently know how to make such a proof regarding neural networks; but that's not because of Gödel.

Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by Zababa on Thursday June 25, 2026 @05:45AM (#48671182)
No actually I don't think it does and I don't think they're related.