> We don't have that with algorithmic decision making (yet) where organizations wash off their hands saying "Oops! It was an algorithm, we didn't do anything!"

That's what individuals within companies do all the time.

You're onto something, form a limited liability company for your AIs and hire them as contractors. There, a clear assigned accountable entity :)