Production AI systems are hard

Re:Production AI systems are hard by brookst on Monday May 29, 2023 @03:52PM (#36117377)

> What percentage of the diagnostic radiologists won't bother to even review the AI output?

If someone’s not going to do their job, why does AI matter at all? Why wouldn’t they just use the same boilerplate text for everyone today?

[ Parent | on HN ]

Re:Production AI systems are hard by kurthr on Monday May 29, 2023 @05:49PM (#36118508)

Because it's a lot easier to rationalize not doing your job when it is (or at least seems to be) being done OK. There's a lot of rationalizing of decisions, when you've spent your life saying you're the expert helping people. Also, a lot easier for management to hand out a LOT more work since it looks like it's being done right.

It's like the lawyer using ChatGPT to file legal briefs... he'd feel bad and be obviously incompetent, if he didn't file anything at all, but didn't feel bad (or feel the need to check anything) once it "looked right".

[ Parent | on HN ]

Re:Production AI systems are hard by akiselev on Monday May 29, 2023 @06:44PM (#36118991)

> Because it's a lot easier to rationalize not doing your job when it is (or at least seems to be) being done OK. There's a lot of rationalizing of decisions, when you've spent your life saying you're the expert helping people. Also, a lot easier for management to hand out a LOT more work since it looks like it's being done right.

It doesn't matter what the radiologist rationalizes - they're going to get killed by malpractice lawsuits. Imaging is particularly prone since the radiologists' work product and a second opinion is all the evidence the plaintiff needs if something obvious was missed.

> It's like the lawyer using ChatGPT to file legal briefs... he'd feel bad and be obviously incompetent, if he didn't file anything at all, but didn't feel bad (or feel the need to check anything) once it "looked right".

That lawyer is going to get sanctioned. It's an open question if he loses his license but he's not getting off scott free.

[ Parent | on HN ]

Re:Production AI systems are hard by theage on Tuesday May 30, 2023 @03:51AM (#36122198)

I don't mind if lawyerGPT is used to help my one-off case, time enough to get that right for human eyes.

However, since I'm the final set of eyes judging my care I'll be asking to see a doctor who has never been assisted by AI and is in fact not a mind-atrophied cyborg. Who knows when this opinion will morph into harmspreading and wrongthink that gets you escorted to the schizo wing instead. AI might yet be paraded as safe and effective.

[ Parent | on HN ]