This is just going to be another case of patients needing to take ownership of their own care. It’s no longer “tell the doc your symptoms and they’ll figure out what’s wrong”, it’s now “tell the doc what you think you have and if they interrupt you and brush it off, go to another doc” until someone agrees with your diagnosis and gets you the referral or test or prescription that you need. For those who know what I’m talking about, I’m sorry. For those who don’t- you’ll learn this lesson someday.

I was at the hospital last week for a pretty bad condition and my IV was badly set. I told the nurse to change it for 4 days, they kept refusing, trying to adjust it.

Eventually I just told the doctor what was happening, and he said "oh, that's why your readings were messed up, I was wondering why I had to change your drug dose every day".

They changed my IV in the next hours, and my conditions improved overnight.

I discussed that with some doctor and nurse friends, and they all told me to never, ever trust a health practitioner you don't know very well. You need to be very proactive in your treatment, because they are exhausted, have many people to treat in a row and are only humans.

If someone’s not going to do their job, why does AI matter at all? Why wouldn’t they just use the same boilerplate text for everyone today?

It's like the lawyer using ChatGPT to file legal briefs... he'd feel bad and be obviously incompetent, if he didn't file anything at all, but didn't feel bad (or feel the need to check anything) once it "looked right".

It doesn't matter what the radiologist rationalizes - they're going to get killed by malpractice lawsuits. Imaging is particularly prone since the radiologists' work product and a second opinion is all the evidence the plaintiff needs if something obvious was missed.

> It's like the lawyer using ChatGPT to file legal briefs... he'd feel bad and be obviously incompetent, if he didn't file anything at all, but didn't feel bad (or feel the need to check anything) once it "looked right".

That lawyer is going to get sanctioned. It's an open question if he loses his license but he's not getting off scott free.

However, since I'm the final set of eyes judging my care I'll be asking to see a doctor who has never been assisted by AI and is in fact not a mind-atrophied cyborg. Who knows when this opinion will morph into harmspreading and wrongthink that gets you escorted to the schizo wing instead. AI might yet be paraded as safe and effective.

In my opinion, an AI system like this (diagnostics) shouldn't even be implemented until it is statistically the case that "won't bother to even review the AI output"-level poor performance on the part of radiologists produces better outcomes than a traditional non-AI system. Then we don't have to worry about what happens when the radiologist isn't good enough to review their work product: the answer is that the medical care is at least better than it would have otherwise been. Deploying a system like that would improve medical outcomes with minimal disruptions.

That said, I think we'll reach that point (statistically provable that an AI system is making better diagnoses than the average radiologist) sooner than most people probably think, maybe a couple of years and then [regulatory approval] years until it's actually used. That doesn't mean radiologists shouldn't exist, though. A radiologist fits into a much larger organisational framework - they file paperwork, they hold responsibility, they are ostensibly available to call and ask about a specific quirk, etc. Even with a 100% perfect AI at the task of "what disease, if any, is indicated by this image?", that still doesn't automate a radiologist's job. A lot of other stuff needs to happen first.