News for hackers. Stuff that matters.

A comment on Internal representations of LLMs encode information about truthfulness. Parent comment

Re:Internal representations of LLMs encode information about... by og_kalu on Wednesday October 30, 2024 @04:56PM (#42000201)
What is a reasoning machine though ? And why is there an assumption that one can exist without flaws? It's not like any of the natural examples exist this way. How would you even navigate the real world without the flexibility to make mistakes ? I'm not saying people shouldn't try but you need to be practical. I'll take the General Intelligence with flaws over the fictional one without any day.

>Having deeply flawed machines in the sense that they perform their tasks regularly poorly seems like an odd choice to pursue.

State of the art ANNs are generally mostly right though. Even LLMs are mostly right, that's why hallucinations are particularly annoying.

[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by RandomLensman on Wednesday October 30, 2024 @06:26PM (#42001189)
Not my usage experience with LLMs. But that aside, poorly performing general intelligence might just not be very valuable compared to highly performing narrow or even zero intelligence.
[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by og_kalu on Wednesday October 30, 2024 @07:17PM (#42001621)
Well LLMs are very useful and valuable to me and many others today so it's not really a hypothetical future. I'm very glad they exist and there's no narrow intelligence available that is a sufficient substitute.
[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by RandomLensman on Thursday October 31, 2024 @05:10AM (#42004809)
Not disputing that, but still think as far as reasoning or thinking machines are concerned it is a dead end.
[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by og_kalu on Thursday October 31, 2024 @12:17PM (#42008353)
I see. Well as far as I'm concerned, they already reason with the standards we apply to ourselves.

People do seem to have higher standards for machines but you can't eat your cake and have it. You can't call what you do reasoning and turn around and call the same thing something else because of preconceived notions of what "true" reasoning should be.

[ Parent | on HN ]