Re:Why is the AI black box such a big deal?
by rvz on Tuesday March 21, 2023 @01:56PM
(#35249863)
Nope. My point is in general with AI with deep neural networks as black boxes being very untrustworthy no matter the application, unless it is for non-serious uses.
Using deep learning AI in medical imaging is just as opaque to a doctor as rolling a dice as a random number generator to see if won't get confused by a faulty pixel or bad input and misinterpret what it is seeing for something else, leading to mis-diagnosis, which is a life changing risk.
It is no good for them to use the output of an AI that just 'explains' by giving a number of 99% and its incorrect without any transparent way of reasoning for that output or explanation which is exactly what medical professionals want to avoid, hence multiple doctors have to review it because they *do not* trust it.
Using deep learning AI in medical imaging is just as opaque to a doctor as rolling a dice as a random number generator to see if won't get confused by a faulty pixel or bad input and misinterpret what it is seeing for something else, leading to mis-diagnosis, which is a life changing risk.
It is no good for them to use the output of an AI that just 'explains' by giving a number of 99% and its incorrect without any transparent way of reasoning for that output or explanation which is exactly what medical professionals want to avoid, hence multiple doctors have to review it because they *do not* trust it.