News for hackers. Stuff that matters.
Re:China's First Frontier AI Export Controls: Mofcom Announc... by willis936 on Monday November 02, 2026 @04:47AM (#50334822)
>I wouldn’t trust models from China enough to use them in important work unless they were open.

So you've inspected the weights for backdoors?

Re:China's First Frontier AI Export Controls: Mofcom Announc... by vidarh on Monday November 02, 2026 @07:41AM (#50336060)
There are risks in both cases, but they are very different.

If you're using a closed model, the model provider gets all your data, and can if they want to send back actively hostile tool calls and rely on your harness to catch them without any effort on their side to train that behaviour into their models. The only things you can do about that is to place careful restrictions

If you're using an open model against your own system or a third party provider, the origin of that model could have trained in "triggers" that'd cause the model to produce actively hostile tool calls as well, but they'd have no direct control and would need to train in that behaviour "blind" to how you'd actually use the model.

It doesn't mean you can be complacent about trusting the model, but it does change the likelyhood they'd be able to do any damage, not least because you'd be able to run evals against the model without any risk that the model or provider API could just randomly change on you after a while.

So it takes far more trust to run a closed model than to run an open model even on a hosted third party provider, and certainly far more than to run an open model on your own hardware.

Re:China's First Frontier AI Export Controls: Mofcom Announc... by codedokode on Monday November 02, 2026 @07:47AM (#50336110)
You can run Chinese models locally without Internet, while with US models you need to have Internet connection. Guess where it is easier to hide a backdoor.