News for hackers. Stuff that matters.
Re:Cybersecurity researchers aren't happy about the guardrai... by mips_avatar on Wednesday June 10, 2026 @06:57PM (#48483946)
They've said that they'll stop notifying developers when this gets triggered, instead they'll load in basically like a LORA that's designed to inject bugs into your code.
Re:Cybersecurity researchers aren't happy about the guardrai... by HDBaseT on Wednesday June 10, 2026 @07:07PM (#48484024)
Antrophic wants to stop training models and ride out Mythos / Fable for as long as possible.

They are trying to expand the 6-18 month gap they have against China-based models. Could the gap widen to say 24 months behind?

Re:Cybersecurity researchers aren't happy about the guardrai... by p-e-w on Wednesday June 10, 2026 @08:06PM (#48484561)
Their gap over Chinese models like GLM-5.1 is nowhere near 18 months. In many areas, it’s less than 6 months. The best closed models 18 months ago were worse than Qwen3.6.
Re:Cybersecurity researchers aren't happy about the guardrai... by echelon on Wednesday June 10, 2026 @09:49PM (#48485313)
These coding agent models only started getting useful in January. Before that they were difficult to control autocomplete, and not very smart.

January was an inflection point, and no open weights model has crossed over that same threshold.

This is definitely recursive self improvement territory, except that we're prohibited from participating.

It feels like the capability gap is wider than before.

Re:Cybersecurity researchers aren't happy about the guardrai... by slopinthebag on Thursday June 11, 2026 @12:34AM (#48486252)
It was more like November. But it wasn’t really an inflection point, harnesses got good enough that people started noticing by the holiday break. And I’m not discounting some good ol’ stealth marketing in there as well.

Deepseek feels pretty close to Opus at this point, and it’s certainly useful enough for me to spend $20 on api tokens instead of four Claude max plans….

Re:Cybersecurity researchers aren't happy about the guardrai... by lbreakjai on Thursday June 11, 2026 @05:16AM (#48488065)
Have you tried deepseek V4? It costs pennies and is as good as Opus 4.6 (I found 4.7 to be a downgrade, and cancelled my claude subscription before 4.8).

The threshold has definitely been crossed.

Re:Cybersecurity researchers aren't happy about the guardrai... by echelon on Thursday June 11, 2026 @01:15PM (#48493227)
It is not as good as Opus. I've tried to write Rust with it (and Codex for that matter), and it's awful.
Re:Cybersecurity researchers aren't happy about the guardrai... by nomel on Wednesday June 10, 2026 @07:45PM (#48484395)
> a LORA that's designed to inject bugs into your code

A statement like this, clearly, requires a reference.

Re:Cybersecurity researchers aren't happy about the guardrai... by mips_avatar on Wednesday June 10, 2026 @07:49PM (#48484420)
From the model card: "the safeguards will limit effectiveness through methods such as prompt modification, steering vectors, or parameter-efficient fine-tuning" aka they will take your ML research code and inject bugs into it until it breaks using a LORA (or some other form of PEFT)
Re:Cybersecurity researchers aren't happy about the guardrai... by nomel on Wednesday June 10, 2026 @07:56PM (#48484469)
Thanks, I thought maybe I missed something. That's an interesting way to interpret that.
Re:Cybersecurity researchers aren't happy about the guardrai... by giancarlostoro on Wednesday June 10, 2026 @08:02PM (#48484516)
PEFT is a library, one of its capabilities is to produce LoRAs.

See:

https://heidloff.net/article/efficient-fine-tuning-lora/

Re:Cybersecurity researchers aren't happy about the guardrai... by adw on Wednesday June 10, 2026 @08:28PM (#48484742)
It's just an acronym, "parameter-efficient fine tuning". LoRA is one method, prefix tuning is another, there are more.
Re:Cybersecurity researchers aren't happy about the guardrai... by mips_avatar on Wednesday June 10, 2026 @08:06PM (#48484564)
Anthropic is trying to hide bad behavior by being vague, it's important to not be vague when calling it out.
Re:Cybersecurity researchers aren't happy about the guardrai... by nomel on Wednesday June 10, 2026 @08:25PM (#48484720)
I'm of the opinion that removing guardrails is how you force regulation. What's your opinion on the balance?
Re:Cybersecurity researchers aren't happy about the guardrai... by dannyw on Wednesday June 10, 2026 @09:13PM (#48485057)
They have all transcripts for at least 30 days. The problem is that (as anyone who used Fable can attest) their classifiers are extremely sensitive and catch tons of innocent queries.

Imagine being a data scientist or MLE training a small classifier model. How do you know you won’t get steering vectors or a PEFT applied?

Re:Cybersecurity researchers aren't happy about the guardrai... by nomel on Wednesday June 10, 2026 @10:32PM (#48485580)
Since your answer isn't direct, I'm having a little trouble interpreting it.

Are you saying they should relax guardrails since they have 30 days to know if you produced something bad? If that is what you're saying, then I suspect they chose their current path to prevent, since you can't un-produce. Producing is what would cause regulations/PR problems.

Re:Cybersecurity researchers aren't happy about the guardrai... by dannyw on Thursday June 11, 2026 @12:49AM (#48486340)
Sorry, I’m specifically referring to the silent degradation of the model to “limit frontier LLM development”. From the description, it appears to encapsulate far more than frontier LLM development, but general ML research and development too.

Those cases are never bad for the world firstly, and a broad coverage of ML work is even more damaging.

My proposal would be (1) don’t degrade models, with 30D retention I’m sure they can do a reasonable job at banning deepseek or whatever, or (2) surface user facing refusals instead of silently degrading ML work.

Re:Cybersecurity researchers aren't happy about the guardrai... by mips_avatar on Wednesday June 10, 2026 @10:41PM (#48485650)
They’re not safety guardrails they’re anthropic doesn’t like anyone who isn’t anthropic working on AI rails
Re:Cybersecurity researchers aren't happy about the guardrai... by bee_rider on Wednesday June 10, 2026 @08:53PM (#48484916)
“Limit effectiveness” could mean introducing performance degradation in your code. Which is arguably some sort of performance bug (I mean, ML codes are supposed to be high performance so I’d call unnecessary degradation a bug), but it could be borderline.
Re:Cybersecurity researchers aren't happy about the guardrai... by rurban on Thursday June 11, 2026 @01:51AM (#48486667)
No, it is just a prominent "Cyber Security threat detected" blocker, with a button to appeal. I appealed because my work had nothing to do with neither cyber nor security, but the appeal was auto-closed. So no more Claude for this work.
Re:Cybersecurity researchers aren't happy about the guardrai... by sciencejerk on Thursday June 11, 2026 @12:43AM (#48486308)
Are they trying to fight back against model distillation?