This is dependent on having a court system uncaptured by corruption. We're already seeing that large corporations in the "too big to fail" categories fall outside of government control. And in countries with bribing/lobbying legalized or ignored they have the funds to capture the courts.
"oh I'm sorry your hospital burned down mr plantiff but the electrician was following his professional rules so his liability is capped at <small number> you'll just have to eat this one"
I would wager that a solid half if not more of the economy exists under some sort of arrangement like that.
Sounds to me like following orders is in fact this magical thing that causes courts to direct liability away from the defendant.
We generally don't hold people liable for acts of God or random chance failures. For example, malpractice suits generally need to prove that a doctor was intentionally negligent on their responsibility.
Everything in real life has quantifiable risk, and part of why we have governing bodies for many things is because we can improve our processes to reduce the risk.
It's not just following orders :) it's recognizing that the solution to risks isn't to punish the actor but to improve the system.
I said this in response to the example above, that humans are needed where accountability is a concern. This is pretty distant from the macro.
If we think of the 19th century economy... it was mostly about food, household products and suchlike. Now the economy is a lot harder to reason about and it's easy to miss the forrest for the trees... when talking about how technology will affect it.
Accountability is required to work with your payment processor, which works with visa and mastercard, that also have requirements, etc. Depending on where (of anywhere) paradigm shifts occur... we may or may not even need these functions.
That's why it's so hard to reason our way to predictions about upcoming Ai-mediated changes.
If we think of the digitization tech revolution... the changes it made to the economy are hard to describe well, even now.
In the early days, it was going to turn banks from billion dollar businesses to million dollar ones. Universities would be able to eliminate most of their admin. Accounting and finances would be trivialized. Etc.
Earlier tech revolution s were unpredictable too... But at lest retrospectively they made sense.
It's not that clear what the core activities of our economy even are. It's clear at micro level, but as you zoom out it gets blurry.
Why is accountability needed? It's clearly needed in its context... but it's hard to understand how it aggregates.