Re:Cybersecurity researchers aren't happy about the guardrai...
by nomel on Wednesday June 10, 2026 @08:25PM
(#48484720)
I'm of the opinion that removing guardrails is how you force regulation. What's your opinion on the balance?
[ Parent
| on HN ]
Re:Cybersecurity researchers aren't happy about the guardrai...
by dannyw on Wednesday June 10, 2026 @09:13PM
(#48485057)
They have all transcripts for at least 30 days. The problem is that (as anyone who used Fable can attest) their classifiers are extremely sensitive and catch tons of innocent queries.
Imagine being a data scientist or MLE training a small classifier model. How do you know you won’t get steering vectors or a PEFT applied?
Re:Cybersecurity researchers aren't happy about the guardrai...
by nomel on Wednesday June 10, 2026 @10:32PM
(#48485580)
Since your answer isn't direct, I'm having a little trouble interpreting it.
Are you saying they should relax guardrails since they have 30 days to know if you produced something bad? If that is what you're saying, then I suspect they chose their current path to prevent, since you can't un-produce. Producing is what would cause regulations/PR problems.
Re:Cybersecurity researchers aren't happy about the guardrai...
by dannyw on Thursday June 11, 2026 @12:49AM
(#48486340)
Sorry, I’m specifically referring to the silent degradation of the model to “limit frontier LLM development”. From the description, it appears to encapsulate far more than frontier LLM development, but general ML research and development too.
Those cases are never bad for the world firstly, and a broad coverage of ML work is even more damaging.
My proposal would be (1) don’t degrade models, with 30D retention I’m sure they can do a reasonable job at banning deepseek or whatever, or (2) surface user facing refusals instead of silently degrading ML work.
Re:Cybersecurity researchers aren't happy about the guardrai...
by mips_avatar on Wednesday June 10, 2026 @10:41PM
(#48485650)
They’re not safety guardrails they’re anthropic doesn’t like anyone who isn’t anthropic working on AI rails