ChatGPT terms disallow its use in providing legal and medical advice to others

Re:ChatGPT terms disallow its use in providing legal and med... by zamadatix on Thursday November 06, 2025 @02:26PM (#45839210)

Again, it's not that all telehealth doctors are great at this, it's that LLMs are awful at caving in to saying something with warnings the reader will opt to ignore instead of being adamant things are just too uncertain to say anything of value when continually prompted.

This is largely because an LLM guessing an answer is rewarded more often than just not answering, which is not true in the healthcare profession.

[ Parent | on HN ]

Re:ChatGPT terms disallow its use in providing legal and med... by caturopath on Thursday November 06, 2025 @09:59PM (#45843135)

I follow the logic, I'm just not sure the claim is right.

[ Parent | on HN ]

Re:ChatGPT terms disallow its use in providing legal and med... by sarchertech on Friday November 07, 2025 @08:26AM (#45846096)

LLMs almost never reply with I don’t know. There’s been mountains of research as to why this is, but it’s very well documented behavior.

Even in the rare case where an LLM does reply with I don’t know go see your doctor, all you have to do is ask it again until you get a response you want.

[ Parent | on HN ]