From GPT-4 to GPT-5: Measuring Progress in Medical Language Understanding [pdf]

Re:From GPT-4 to GPT-5: Measuring Progress in Medical Langua... by ares623 on Thursday August 21, 2025 @10:51PM (#44980562)

I get trying and improving until you get it right. But I just can't make the bridge in my head around

1. this is magic and will one-shot your questions 2. but if it goes wrong, keep trying until it works

Plus, knowing it's all probabilistic, how do you know, without knowing ahead of time already, that the result is correct? Is that not the classic halting problem?

[ Parent | on HN ]

Re:From GPT-4 to GPT-5: Measuring Progress in Medical Langua... by theshackleford on Friday August 22, 2025 @01:55AM (#44981418)

> I get trying and improving until you get it right. But I just can't make the bridge in my head around

> 1. this is magic and will one-shot your questions 2. but if it goes wrong, keep trying until it works

Ah that makes sense. I forgot the "magic" part, and was looking at it more practically.

[ Parent | on HN ]

Re:From GPT-4 to GPT-5: Measuring Progress in Medical Langua... by ares623 on Friday August 22, 2025 @03:33AM (#44981888)

To clarify on the “learn and improve” part, I mean I get it in the context of a human doing it. When a person learns, that lesson sticks so errors and retries are valuable.

For LLMs none of it sticks. You keep “teaching” it and the next time it forgets everything.

So again you keep trying until you get the results you want, which you need to know ahead of time.

[ Parent | on HN ]