News for hackers. Stuff that matters.
Re:Cybersecurity researchers aren't happy about the guardrai... by CGamesPlay on Wednesday June 10, 2026 @09:18PM (#48485100)
The announcement elucidated this, and it's IMO worse than this. They don't downgrade to a cheaper model ([edit] for certain classes of offense they suspect you of). They sabotage the model's outputs in other, undisclosed, ways (specifically, "prompt modification, steering vectors, or parameter-efficient fine-tuning"). So, for example, they might load in a steering vector that just forgets the API to PyTorch. But it isn't just "we redirected you to a cheaper model!"
Re:Cybersecurity researchers aren't happy about the guardrai... by buildbot on Wednesday June 10, 2026 @09:43PM (#48485281)
It honestly explains so many issues I have been having, as I used it primarily for ML research (on my personal account, doing things not related to my job I should note). It would literally typo package names and spend huge amounts of time failing to setup simple environments…then do stupid things like set the learning rate to 1e-7, and use the eval set as training data.
Re:Cybersecurity researchers aren't happy about the guardrai... by sterlind on Thursday June 11, 2026 @12:15AM (#48486122)
just imagine if they made it sneaky. get things just subtly wrong enough that your training runs just never quite go as well as you think they should.
Re:Cybersecurity researchers aren't happy about the guardrai... by peyton on Wednesday June 10, 2026 @10:56PM (#48485729)
That’s insane. I hope they fix it.
Re:Cybersecurity researchers aren't happy about the guardrai... by baq on Thursday June 11, 2026 @12:41AM (#48486294)
Nothing to fix. This is working as designed.

Using codex for this use case is the fix.

Re:Cybersecurity researchers aren't happy about the guardrai... by peyton on Friday June 12, 2026 @10:28PM (#48512057)
They fixed it.
Re:Cybersecurity researchers aren't happy about the guardrai... by notrealyme123 on Thursday June 11, 2026 @01:08AM (#48486451)
It burned through all of my tokens in a very short time. I wonder if it their ML mitigations leads to model into deadlocks.
Re:Cybersecurity researchers aren't happy about the guardrai... by razster on Thursday June 11, 2026 @01:23AM (#48486515)
This explains why I've been running into some odd roadblocks. Welp that sealed the deal, I'm going to be cancelling our company sub, not worth it.
Re:Cybersecurity researchers aren't happy about the guardrai... by yaur on Thursday June 11, 2026 @04:54AM (#48487938)
Did my Claude get permanently dumber today because I asked fable to assess my Fairplay integration?