News for hackers. Stuff that matters.
Re:Evidence that LLMs are reaching a point of diminishing re... by cratermoon on Sunday April 14, 2024 @05:58PM (#40034837)
Does anyone have a link to a prediction Sam Altman made more than 24 months ago that turned out correct?
Re:Evidence that LLMs are reaching a point of diminishing re... by kromem on Sunday April 14, 2024 @06:03PM (#40034870)
> In the next five years, computer programs that can think will read legal documents and give medical advice.

- https://moores.samaltman.com/ (March 2021)

Re:Evidence that LLMs are reaching a point of diminishing re... by pyb on Sunday April 14, 2024 @08:22PM (#40035779)
They can do this, badly. Is it a successful prediction?
Re:Evidence that LLMs are reaching a point of diminishing re... by AshamedCaptain on Sunday April 14, 2024 @06:07PM (#40034902)
Wow that is pure genious, he didn't say anything about the advice being wrong, or the legal documents comprising fictional cases.
Re:Evidence that LLMs are reaching a point of diminishing re... by iLoveOncall on Sunday April 14, 2024 @06:12PM (#40034936)
WebMD exists since 1996, it's easy to predict something that already exists.
Re:Evidence that LLMs are reaching a point of diminishing re... by kromem on Sunday April 14, 2024 @06:24PM (#40035018)
The prediction wasn't the existence of the product, but what was feeding into the content of the product (WebMD doesn't exist spontaneously).

Also relevant:

> Six patients 65 years or older (2 women and 4 men) were included in the analysis. The accuracy of the primary diagnoses made by GPT-4, clinicians, and Isabel DDx Companion was 4 of 6 patients (66.7%), 2 of 6 patients (33.3%), and 0 patients, respectively. If including differential diagnoses, the accuracy was 5 of 6 (83.3%) for GPT-4, 3 of 6 (50.0%) for clinicians, and 2 of 6 (33.3%) for Isabel DDx Companion (Table).

- Use of GPT-4 to Analyze Medical Records of Patients With Extensive Investigations and Delayed Diagnosis (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10425828/)

Re:Evidence that LLMs are reaching a point of diminishing re... by cratermoon on Sunday April 14, 2024 @10:46PM (#40036614)
Well, we don't have any computers programs that can think, so I'd call that a miss.