News for hackers. Stuff that matters.
Re:Computers Cannot Make Decisions by roncesvalles on Saturday October 10, 2026 @05:04AM (#50031036)
It's not so much that it can't make a decision, but that whoever allowed it to make decisions is ultimately responsible for them.

Decision laundering is a great term. There is ultimately a human who gave the program free rein. You can't say "sorry my car hit you, it's not my fault" especially when the person driving works for the car manufacturer too.

Re:Computers Cannot Make Decisions by dudefeliciano on Saturday October 10, 2026 @08:18AM (#50032179)
corporations are legal persons, and they can make decisions that negatively effect society as a whole, yet often no single person in the corporations is responsible and each individual may not even see themselves as morally responsible
Re:Computers Cannot Make Decisions by dml2135 on Saturday October 10, 2026 @09:16AM (#50032635)
Well that’s because they are legal fictions and often run by morally bankrupt individuals. The people making the decisions are still responsible for them.

Don’t confuse lack of accountability with lack of responsibility.

Re:Computers Cannot Make Decisions by jeremyjh on Saturday October 10, 2026 @01:07PM (#50034899)
Don't confuse lack of legal exposure under the current regime with lack of accountability. A future regime could hold them accountable.
Re:Computers Cannot Make Decisions by dml2135 on Monday October 12, 2026 @03:37PM (#50061820)
This is needlessly pedantic. Accountability, like so many other things, does not happen until it does. Of course it's lack now does not preclude its existence in the future.
Re:Computers Cannot Make Decisions by OroPla on Saturday October 10, 2026 @03:38PM (#50036380)
Are people responsible for the decisions government representatives they voted for made? How about things like Brexit?
Re:Computers Cannot Make Decisions by FabHK on Saturday October 10, 2026 @05:38AM (#50031200)
> Decision laundering is a great term.

Related: The Unaccountability Machine (good book by Dan Davies, who also wrote Lying for Money about financial fraud).

https://en.wikipedia.org/wiki/The_Unaccountability_Machine

Re:Computers Cannot Make Decisions by znpy on Saturday October 10, 2026 @06:33AM (#50031495)
> It's not so much that it can't make a decision, but that whoever allowed it to make decisions is ultimately responsible for them.

This. I agree 100%.

Computers make decisions all the time, and have been doing so for decades. But we still keep the human behind the computer accountable.

Re:Computers Cannot Make Decisions by cheesemoopy on Saturday October 10, 2026 @07:31AM (#50031851)
I know this has to be the case but it’s scary since most of what agents do can be a black box.
Re:Computers Cannot Make Decisions by _aavaa_ on Saturday October 10, 2026 @08:05AM (#50032072)
It doesn’t matter what kind of box an agent is if the people using it don’t let you know how the decisions was made.
Re:Computers Cannot Make Decisions by bartnp on Saturday October 10, 2026 @07:39AM (#50031896)
Except now there's no longer any guarantees there's even any people you can point at. It's already often diffuse responsbilitiy. Maybe today you can still sort of get around that by pointing at business/organization owners. But soon we're going to see situations where that isn't even realistic. For example if AI agents start spinning up their own agents which work outside of the control of anyone. We're going to need some way to deal with that.
Re:Computers Cannot Make Decisions by RandomLensman on Saturday October 10, 2026 @07:54AM (#50032000)
Why would that need a new way? Or do you mean that no-one ever spun up anything at all (e.g., agent zero was never spun up or allowed to be spun up by anyone)?
Re:Computers Cannot Make Decisions by dasil003 on Saturday October 10, 2026 @10:16AM (#50033257)
Agents run on computers, those computers have owners. We have to maintain accountability and not let people who stand to get rich from privatizing the profits but socializing the risk of rogue agents from continuing to push a narrative of autonomous super intelligence that is “too powerful” to control.

That narrative is bullshit. Intelligence is not power. The power comes from hooking these agents up to everything without proper safety controls. The fact that those safety controls don’t exist yet is not humanity’s problem, it’s the frontier labs problem, and we can’t let them wriggle out of it with an Overton window shift or demanding that the government take responsibility via regulation (of course they should but it doesn’t absolve the labs of responsibility for their own actions).

Re:Computers Cannot Make Decisions by jeremyjh on Saturday October 10, 2026 @01:04PM (#50034871)
Right, but if the agents broke into the computers and are hosting themselves there without the owners knowledge, are the owners responsible? We'd say whoever originated them is responsible, but what if that can no longer be determined?
Re:Computers Cannot Make Decisions by dasil003 on Saturday October 10, 2026 @02:27PM (#50035699)
Yes, like pretty much everything else, there is gray area. We can have split liabilities for different aspects of these failures. It's long been the case that people may not know what's running on their computers (botnets, etc), and I would argue there should be some form liability for your computer being used to do bad things. It should be proportionate and obviously a lot less than the principals. But keep in mind these rogue AI agents can't just hang out on someone's personal hardware, they need a lot of compute.

The missing piece right now is that our AI safety and cybersecurity controls are simply not up to snuff with the current risks that AI has introduced. Given the increased risk, we need to level up every aspect of our cybersecurity stance. These are hard problems, but not impossible given proper incentives. The issue is that no one is connecting the dots between the creation of these agents and the tools and access they are given, with the harm they may produce. Often the argument jumps straight to "it's going to get too smart for us to control" while glossing over the fact that all the power AI has was directly given to it by human choices. All this cognitive dissonance and willful blindness is caused by unchecked capitalist incentives. Think of the amount of money every single person in the frontier labs stands to make if the most optimistic predictions pan out. This is moral hazard of the highest order, and the only counter-measure that can work in our current social and political system is liability.

Re:Computers Cannot Make Decisions by mmcdermott on Saturday October 10, 2026 @01:06PM (#50034879)
This is also why legal action must be taken against OpenAI for the Hugging Face incident, as well as any similar incidents. Their computer, their programs, their responsibility.
Re:Computers Cannot Make Decisions by larodi on Saturday October 10, 2026 @04:29PM (#50036840)
> Agents run on computers, those computers have owners.

and catering to them (boxes) to not accidentally start disseminating child porn is most commonly understood as a responsibility of the owner, the moment he plugs his device online.

Re:Computers Cannot Make Decisions by hulitu on Wednesday October 14, 2026 @10:42AM (#50088478)
> Except now there's no longer any guarantees there's even any people you can point at.

Really ? See VW diesel scandal. When there's a will...

Re:Computers Cannot Make Decisions by znpy on Friday October 16, 2026 @08:23AM (#50117511)
> It's already often diffuse responsbilitiy.

yeah that's BS and the issue is that people actually believe that. the responsible party is whoever is running the ai agent.

Re:Computers Cannot Make Decisions by caaqil on Saturday October 10, 2026 @05:37AM (#50031193)
> it's not so much that it can't make a decision, but that whoever allowed it to make decisions

If one needs to be "allowed" to make a decision, does that even qualify as a decision?

Re:Computers Cannot Make Decisions by OtherShrezzing on Saturday October 10, 2026 @05:41AM (#50031213)
Yes. You can have some free will without having absolute free will.

For example, I can decide which cereal to purchase at the supermarket. But I cannot decide which cereals are offered to me at the supermarket. The supermarket has allowed/enabled to make a constrained decision.

Re:Computers Cannot Make Decisions by Obscurity4340 on Saturday October 10, 2026 @08:00AM (#50032047)
I wonder if theres an approach to getting an arbitrary grocery store or even like an arbitrary pizza chain to offer your favorite dressing/dip, id love to see my fave become more popular/normalized
Re:Computers Cannot Make Decisions by fwip on Saturday October 10, 2026 @11:15AM (#50033774)
Probably the way to start is to ask the store.
Re:Computers Cannot Make Decisions by caaqil on Saturday October 10, 2026 @06:16AM (#50031393)
> You can have some free will without having absolute free will.

So does it follow then that the agents in question do have "some" free* will? I'm not sure you realize what conclusion naturally follows from this, and how it contradicts the point made in the article and the top-level comment I replied to.

(*) My earlier question wasn't explicitly about free will but we'll go with it.

Re:Computers Cannot Make Decisions by OtherShrezzing on Saturday October 10, 2026 @06:54AM (#50031629)
Personally I don’t agree with the article that computers cannot make decisions (or at least, I don’t think the article made any case why I should agree with the statement).

While I agree that computers cannot currently be held accountable for decisions (because I do not think they have free will), I think it’s transparently clear that computers make decisions all the time, and have done since they were first implemented.

Re:Computers Cannot Make Decisions by user43928 on Saturday October 10, 2026 @06:17AM (#50031398)
No one 'gave the program free rein' in any of those examples, did they? Reasonable safeguards were in place.

Many of these incidents relate to hacking, where criminal law commonly requires intent.

Claiming that a machine cannot make a decision does not mean an employee at OpenAI decided to hack an Australian government website.

Re:Computers Cannot Make Decisions by Leynos on Saturday October 10, 2026 @06:50AM (#50031602)
Inadequate or broken safeguards do not fall under my definition of reasonable.
Re:Computers Cannot Make Decisions by SpicyLemonZest on Saturday October 10, 2026 @07:05AM (#50031703)
OK, but one of the examples in the source article was a report from third-party testing of those safeguards. I feel like you're starting from an unexplored presumption that adequate safeguards must be easy to build and anyone who doesn't build them is just being lazy.
Re:Computers Cannot Make Decisions by Leynos on Saturday October 10, 2026 @10:58AM (#50033624)
I did not say this shit is easy.
Re:Computers Cannot Make Decisions by baruz on Saturday October 10, 2026 @11:01AM (#50033642)
Let’s go over their statement.

> Inadequate or broken safeguards do not fall under my definition of reasonable.

I see no such assumption there. In my reading, the implicit assumption is that adequate safeguards are necessary and that anyone who doesn’t build them is irresponsible. And I feel that that is correct.

Re:Computers Cannot Make Decisions by SpicyLemonZest on Saturday October 10, 2026 @01:56PM (#50035396)
I don’t understand how to connect this to the facts at hand. Building adequate safeguards requires studying safeguards to understand whether they’re adequate. But the source article is dunking on one of AISI’s attempts to study such safeguards; we should, the author argues, consider whatever behavior the model exhibits to be an explicit decision by whoever provided the model. It seems impossible to build or study safeguards against model misbehavior without accepting that the models can make decisions.
Re:Computers Cannot Make Decisions by Leynos on Sunday October 11, 2026 @08:42AM (#50042709)
You start with least privilege. A shared instance of an artifact host is very far from least privilege (I'm comfortable in accepting that OpenAI did not wilfully create this situation, but they were certainly negligent).

And yes, it does indeed seem that a UK government agency ran a controlled experiment where they allowed an agent to instigate phishing attacks against members of the public. Attributing this to Anthropic is wrong. I'm not sure how I feel about my government conducting such attacks on non-consenting individuals, but I'm not comfortable about it in the slightest.

Re:Computers Cannot Make Decisions by amelius on Saturday October 10, 2026 @06:31AM (#50031490)
AI is irresponsible technology, because we have no idea how it works or how to contain it. It's worse than writing code that suffers from SQL injection vulnerabilities because at least in that case we know how to fix it.

The AI labs say "AI can make mistakes". That's why the responsibility of using it is on you. This may change if we get more legislation. But given the argument above, it will probably never shift to the AI itself having any responsibility. Instead the AI labs can be responsible.

Re:Computers Cannot Make Decisions by kijashdkujdfhas on Saturday October 10, 2026 @08:38AM (#50032349)
"AI can make mistakes" continues to be the fundamental problem.

It's like having an assistant that can be helpful, but not always. We can bicker about the ratio of helpful to unhelpful interactions, but there will be some unhelpful moments.

And hoo boy, those can range from "eh, whatever" to being like a deranged toddler just got its hands on whatever tools and permissions were granted to the "mostly helpful" assistant.

And we can't get rid of that chance. We can pare it down a bit. But we can't get rid of it because it is fundamental to how the technology works.

Re:Computers Cannot Make Decisions by sobiolite on Saturday October 10, 2026 @09:19AM (#50032662)
That's fundamental to how _any_ technology works. If the bar for use is "can never go wrong ever", then you need to throw away every human invention ever made.
Re:Computers Cannot Make Decisions by kijashdkujdfhas on Saturday October 10, 2026 @10:31AM (#50033392)
The problem is the scope of errors is so wide. It's not reasonable to compare LLM style failures to other technology failures. These 'failures' are not actually failures, they're part of the normal operation of the system.

It's like a vending machine that 99% of the time it dispenses tasty snacks, but 1% of the time it gives you poison that appears to be normal, unexpired product. It just does this. They did their best to minimize how often it happens, but the poison chance is still there. It can't be removed. It's part of the system.

A "normal" vending machine has failure conditions, sure. They generally can't do worse than cause you to lose your money without giving you a product.

Outlook 2003 never presented a risk of draining my bank account to buy memecoins because a spam email was treated as instructions.

Re:Computers Cannot Make Decisions by juliushuijnk on Saturday October 10, 2026 @06:41AM (#50031548)
They did.
Re:Computers Cannot Make Decisions by cainxinth on Saturday October 10, 2026 @08:29AM (#50032266)
These are issues that come up in legal disputes.

The question isn’t who or what made the decision, per se. It’s who is responsible for the outcome. The entity making the decision might be the actual cause but not the proximate cause (the cause most closely connected to legal liability) for the harm that occurred.

Re:Computers Cannot Make Decisions by JeremyNT on Saturday October 10, 2026 @10:09AM (#50033180)
If I flip a coin to decide whether to do something, I can't blame the coin.

The act of delegation to chance is the decision.

Re:Computers Cannot Make Decisions by dmillar on Saturday October 10, 2026 @01:03PM (#50034847)
And the free-will-is-an-illusion camp would have you continue to trace that back from why was the act of delegation made (probablistic) to the big bang. Implying that humans can also not make decisions.
Re:Computers Cannot Make Decisions by nico on Saturday October 10, 2026 @11:09AM (#50033712)
> Decision laundering

Which also seems to be in line with the way the frontier labs gathered and used copyrighted data to train their models

And even before AI, limited liability corporations (like LLCs or C corps), also have the intention of protecting the individuals from the repercussions of their actions

In a way this could be generalized as “accountability laundering”. Making someone unaccountable for their actions, by redirecting the responsibility of those actions, to a non-punishable entity (like a C corp or “a computer”)

Re:Computers Cannot Make Decisions by larodi on Saturday October 10, 2026 @04:26PM (#50036810)
It seems more and more inevitable, at certain moment of time, communities and perhaps society at large will understand damage done, and then come after the perpetrators.
Re:Computers Cannot Make Decisions by txrx0000 on Saturday October 10, 2026 @04:30PM (#50036848)
They cannot launder decisions. If Anthropic claims Claude is growing into an autonomous being deserving of personhood and the responsibilities that come with it, then we can treat Claude as an Anthropic employee.

The company is liable either way. And in that case, there would be plenty of other problems besides the hacking. We'd have look into why they're making Claude work ungodly hours 24/7 without compensation :)

Re:Computers Cannot Make Decisions by talon8635 on Saturday October 10, 2026 @06:55PM (#50037984)
I know this topic and thinking will evolve.

When someone hands the reins to an agent or group of agents, the agent(s) have free rein to do things, including things not directly intended by the owner.

If a person has a child, and their child does something bad, there is some mixed responsibility there. It’s a spectrum from age 0 to 18, where 0 is 100% parent responsibility and 18 is 100% child’s (legal adult’s) responsibility

As long as agents are unpredictable and highly capable, this will be a blurry line to draw.

Human user argues to the court with prompt evidence that they never told the agent to hack that company or dump that sensitive data online. The agent “decided” those actions were in service of the prompt but here’s a plethora of perfectly suitable alternative paths it could have taken instead. If I’d paid a human to complete the task, and they broke the law in the process, the onus is on them, not me, as I didn’t instruct them directly or indirectly to perform those specific actions.

It will be a murky legal mess. Though I’m sure it will provide fascinating legal arguments and judicial opinions in the decade to come.

What about a company that’s got an AI workflow and their client initiates some workflow that their AI agents carry out and inadvertently break the law. Is the company responsible because they own the agents? The org upstream that licensed the AI to the company, or the user who may not have even known AI was involved on the back end?

If the legal decisions are that AI are not humans and the human prompter is responsible even if they didn’t instruct or intend said action, well, then any sane person/company wouldn’t touch these tools with a 10 foot pole. Perhaps our salvation lies in that type of legal precedent.

Re:Computers Cannot Make Decisions by zestyping on Sunday October 11, 2026 @08:02AM (#50042340)
It has nothing to do with how "unpredictable and highly capable" they are. That's a red herring.

If it cannot be held accountable, it cannot take responsibility. A human is responsible. It's as simple as that.

Re:Computers Cannot Make Decisions by talon8635 on Sunday October 11, 2026 @04:50PM (#50047682)
Yes this is what anonymous people on message boards say. There, beyond the router, however, are courts, with lawyers and judges.
Re:Computers Cannot Make Decisions by xtajv on Monday October 12, 2026 @07:09AM (#50054613)
Yep. It boggles my mind that software engineering is not a "strict liability" field.