Re:New benchmark shows top LLMs struggle in real mental heal...
by RicardoRei on Wednesday December 10, 2025 @10:40AM
(#46218954)
This is a good point. We have not tested the clinicians but I believe they would not score each other perfectly as we observed some disagreement also between the scores which also reflects different opinions between clinicians
[ Parent
| on HN ]
Re:New benchmark shows top LLMs struggle in real mental heal...
by megaman821 on Wednesday December 10, 2025 @10:48AM
(#46219107)
It is nice to have an accurate measure of things and a human baseline would be additionally helpful too.
Many things can be useful before they reach the level of world's best. Although with AI, non-intuitive failure modes must be taken into consideration too.