Re:Towards accurate differential diagnosis with large langua...
by guender on Monday December 04, 2023 @06:58PM
(#38525089)
Yikes, do I read this correctly and the LLM alone outperforms clinician + LLM?
[ Parent
| on HN ]
Re:Towards accurate differential diagnosis with large langua...
by fnordpiglet on Monday December 04, 2023 @07:52PM
(#38525613)
This has come up before in similar contexts. Model based decision decisions tend to do better than clinicians alone or clinicians with the model based decision system in general. Despite this it’s been effectively impossible to deploy such systems in a clinical setting due to many issues but one is that clinicians aren’t willing to cede their ground and patients aren’t willing to believe the machine over a human.
Re:Towards accurate differential diagnosis with large langua...
by rafaelero on Monday December 04, 2023 @08:34PM
(#38525892)
I don't see how those models couldn't be used to at least offer a second opinion. They are pretty cheap to run. I doubt patients would complain about that.
Re:Towards accurate differential diagnosis with large langua...
by 0xDEAFBEAD on Monday December 04, 2023 @08:30PM
(#38525862)
Is there any way for me to get ahold of one of these models for my own private use?
Re:Towards accurate differential diagnosis with large langua...
by caycep on Monday December 04, 2023 @07:58PM
(#38525658)
granted, I feel like the training of some physicians also doesn't make them that good at diagnosis. Over time, intuitively understanding the narrative history of the illness/symptoms is key; that being said, nowadays, this sort of thing seems scattershot in some younger physicians.
Med schools tend to try and rejigger their curriculum frequently to try and justifiably make the experience friendlier and w/ less workload for the students, but sometimes, it backfires in terms of this.
I had an older school professor who liked to remark, in his day, no such thing as a differential diagnosis, just the right one and a bunch of wrong ones.
Re:Towards accurate differential diagnosis with large langua...
by ugh123 on Monday December 04, 2023 @07:57PM
(#38525652)
It also outperforms clinician + googling which the study observed (many doctors use google search to help with diagnosis, terminology, recent studies, etc)
Re:Towards accurate differential diagnosis with large langua...
by chrstfer on Wednesday December 06, 2023 @10:32AM
(#38545153)
Hell, the LLMs themselves outperformed clinician plus LLM...
Re:Towards accurate differential diagnosis with large langua...
by lucubratory on Monday December 04, 2023 @07:40PM
(#38525501)
Yeah, it's a bit awkward.
Re:Towards accurate differential diagnosis with large langua...
by rafaelero on Monday December 04, 2023 @08:30PM
(#38525860)
That surprised me as well. The case for humans being merely assisted by AI may not be the strongest one. It could be that they work better without human input, which is at the same time amazing and a bit frightening.
Re:Towards accurate differential diagnosis with large langua...
by Terr_ on Monday December 04, 2023 @08:36PM
(#38525902)
Just to make analysis more complicated, not all errors in are created equal: It may be better to have lots of safe errors versus a few huge ones.
Re:Towards accurate differential diagnosis with large langua...
by kelseyfrog on Monday December 04, 2023 @08:41PM
(#38525944)
Is that across all subspecialties?
I hear internists talking about +LL and -LL all the time and I'd hope that reflected some higher degree of rationality when reasoning out diagnoses, but perhaps not?
Re:Towards accurate differential diagnosis with large langua...
by twobitshifter on Tuesday December 05, 2023 @05:12PM
(#38537651)
Makes sense. In many applications the ‘human in the loop’ will become the weakest link. Imagine giving alpha go to players as a suggested move assistant. Even the best players would have seen alpha go’s suggestions and thought they were an error. Can we eventually trust AI even if we can’t understand its reasoning?
Re:Towards accurate differential diagnosis with large langua...
by chrstfer on Wednesday December 06, 2023 @10:34AM
(#38545185)
They'll be able to explain their reasoning......
Re:Towards accurate differential diagnosis with large langua...
by twobitshifter on Wednesday December 06, 2023 @10:57AM
(#38545557)
Explaining and understanding the explanation are different.