Workers, patients, and customers don't get this choice. I work on hospital systems that use "AI" and we wouldn't survive a proper code audit for what we claim saves lives. We get audited by the FDA, but they aren't combing through our code - just the documentation that we write.

Sure, we describe the algorithms put together by our researchers, but even the rank-and-file developers mostly just consume the algorithms that decide what to tell Doctors taking care of the patients.

For now, at least, Doctors and Nurses mostly use our software as a retrospective tool. I know we're not selling it that way and I worry about the day folks are using this system in place of their years of experience.

The statistics we put out say our software is x% better than the Doctor at making these decisions, is that true? Who knows, but an audit to make sure we're not selling snake oil might save lives.

> Everything that does anything is an algorithm. Will we have to get government authorisation before we can quicksort?

This just sounds like a strawman argument. If you say, 'our proprietary algorithm will save thousands of lives from malpractice,' you better be ready to back that up with an audit. It better not be a bridge that's going to fall apart when an eighteen wheeler travels across it for the first time.