I don't see why these standards should change when the hammer also emits text messages.
This doesn't seem to be the case today (weapons manufacture).
These things can and do say “sorry I won’t help you with that” based on the nature of your request. What do you call that if not a refusal?
The obvious problem being that the user doesn't have any need to provide the context that they're trying to commit a crime and can just ask how to do something without providing a reason or making one up.
At which point you'd have the model trying to impute a reason and often getting it dangerously wrong, e.g. refusing to disclose a vulnerability when the user is actually the defender who needs to patch/mitigate it.
I'm neither American nor a lawyer.
Is "conspiracy" protected under the first amendment?
If you discuss a crime with someone to learn about it, does that count as "conspiracy"?
Replace 'conspiracy' with 'agreement'. Discussing a crime is not a conspiracy. Agreeing with someone to commit the crime is.
This leads to LLMs refusing to do security work for anyone, because it can’t tell if it’s being done for good or evil purposes.
Which is precisely what we’re going through right now with frontier models and it’s terrible.
These proposals always assume some perfect mechanism for identifying the thought crime with triggering on the normal requests. The people who want to commit crimes just persist until they jailbreak the guardrails while the rest of us suffer with denials.
Also if you can’t imagine these guardrails being used by governments to control inconvenient speech, you probably need to think a little harder about the realities of how these will be used.
Oh no, of only we had some sort of ideas about automated authentication and authorisation! (If big AI actually make a model that would reliably reject dangerous queries in the first place, they can just use auth tech to serve the current ones to vetted customers)
Your solution is to require everyone to surrender their privacy and then allow some company or government decide who is worthy of being allowed to use AI?
It’s crazy how authoritarian, controlling, and anti-privacy the anti-LLM conversation is getting.
Not happening, for two reasons
1) LLMs mix attacker-controlled data into their instruction stream, and it doesn't look at all like the big LLM providers consider making that impossible to be an actual priority.
2) Intent is what distinguishes "dangerous" queries from prosocial ones. Reliably determining intent is so complex that not even humans can do it.
terrible is a bit far, but pretty hilarious for sure
This obviously doesn't work at all when the agents start doing real things in the real world, though. "Hey AI, I don't like my neighbor, find an exploit in the firmware for his car and make the cruise control malfunction and crash him next time he gets on the highway". This is committing a crime, not just talking about theoretical crimes. The AI can and should refuse it.
I think he's anticipating and discarding this objection with his introduction, which otherwise feels disconnected from the rest of the article. FWIW, I have changed a bike tire and I'm pretty sure most of the MTS at the big labs could. This sort of "they're just bookworms who don't understand the physical world" rhetoric aside, we are currently seeing a ton of effort and expense go towards giving the AI agents hooks into being able to perform as many real-world-consequential actions as possible. And you can do a surprising amount with just bits, from writing code to breaking into systems to sending some combination of emails, phone calls, and currency to instruct meatspace humans to do things, etc.