News for hackers. Stuff that matters.

A comment on Some Neural Networks Learn Language Like Humans. Parent comment

Re:Some Neural Networks Learn Language Like Humans by jameshart on Monday May 22, 2023 @05:19PM (#36036862)
The important part is in the parens at the end of course:

> There can be a temptation to learn lots of fancy words and to use them in fancy sentences without being able to say precisely what you mean. You should feel free to do that, but you should always feel a pang of guilt when you do.

GPT - as far as we know - feels no guilt pangs whatsoever.

[ Parent | on HN ]
Re:Some Neural Networks Learn Language Like Humans by jimmygrapes on Monday May 22, 2023 @07:00PM (#36037784)
Surely there is a confidence score (perhaps hidden) that could be used to emulate such a sense of guilt. Maybe next time.
[ Parent | on HN ]
Re:Some Neural Networks Learn Language Like Humans by s0ulphire on Tuesday May 23, 2023 @01:22AM (#36040190)
'Temperature' would probably already be close, which controls how much GPT takes low probability (could reasonably be interpreted as confidence?) into account.
[ Parent | on HN ]