News for hackers. Stuff that matters.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by paulryanrogers on Wednesday June 14, 2023 @06:51PM (#36333955)
> ...only if you feed it perfect information, and the actual patient has a classic presentation, which is rarely the case. (And you don’t mind a 50% success rate that often misses life-threatening conditions.)

This sounds like a step backwards?

Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by danmaw on Wednesday June 14, 2023 @07:06PM (#36334114)
It isn't a doctor, it's trained on Reddit threads and other random shit off the internet not medical journals.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by jprafael on Wednesday June 14, 2023 @07:22PM (#36334275)
Given that "The Pile" includes PubMed and NIH as data sources it would be unlikely to have GPT4 not use them at all. Even GPT3 uses Wikipedia which does have (mostly) factual data with cited sources.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by tazjin on Wednesday June 14, 2023 @07:33PM (#36334364)
> Even GPT3 uses Wikipedia which does have (mostly) factual data with cited sources.

There's a LOT of stuff on Wikipedia where the source is a link to some random, long article and it's unclear where exactly the referred to information is coming from. Gets significantly worse for any "hot" topic.

Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by ekianjo on Wednesday June 14, 2023 @07:31PM (#36334351)
Problem is half of the publications or even more is pure garbage that cannot be reproduced so there is that.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by kaliqt on Wednesday June 14, 2023 @07:47PM (#36334493)
It's lossy though, it tries to remember everything and relate that to everything else. Performance would increase significantly if it were tuned for that use case.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by fnordpiglet on Wednesday June 14, 2023 @09:32PM (#36335306)
You should try asking it detailed questions about medicine. It’s fairly deep and broad in its medical “knowledge.” But it’s not good at deductive or inductive reasoning and has no agency, so is entirely unsurprising it’s not good at differential diagnosis. We actually have good differential diagnosis expert systems the challenge is getting the providers to input queries properly. I can imagine GPT4 acting as an intermediary between human natural language and expert systems to great effect. It seems rather rash to be judging these technologies based off a crappy web UI thrown on a chatbot a few months ago.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by potatoman22 on Friday June 16, 2023 @12:04AM (#36351073)
Providers don't input queries "properly" because differential diagnosis software is complicated, clunky, and not easy to use for the overworked clinician.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by colechristensen on Wednesday June 14, 2023 @07:11PM (#36334159)
Then you haven’t had much experience with doctors… you go in and you’re most likely getting either a cast, a broad spectrum antibiotic, or an antidepressant. The only things that get specific diagnoses reliably is when somebody finds a tumor.

In the last year I had to get a full antiparasite treatment course because a doctor misdiagnosed my partners psoriasis… that was fun.

Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by wilonth on Wednesday June 14, 2023 @07:48PM (#36334505)
True, 90% of doctor diagnosis are garbage and maybe even worse than ChatGPT. The 10% is for when you have a visible problem that can be cured with a surgery, they are pretty good at that. A doctor with GPT-4 could be way better than one without.
Re:I’m an ER doctor. Here’s how I’m already using ChatGPT to... by colechristensen on Wednesday June 14, 2023 @08:07PM (#36334688)
They already have diagnosis flowcharts where it’s a game it follow the symptom. It would have to be considerably better than the tools they already have to be appropriate.