News for hackers. Stuff that matters.
Re:Internal representations of LLMs encode information about... by og_kalu on Wednesday October 30, 2024 @12:25PM (#41996998)
What exactly do you imagine is the alternative ? To build generally intelligent machines without flaws ? Where does that exist ? In...ah that's right. It doesn't except in our fiction and in our imaginations.

And it's not for a lack of trying. Logic cannot even handle Narrow Intelligence that deals with parsing the real world (Speech/Image Recognition, Classification, Detection etc). But those are flawed and mis-predict so why build them ? Because they are immensely useful, flaws or no.

Re:Internal representations of LLMs encode information about... by RandomLensman on Wednesday October 30, 2024 @12:37PM (#41997155)
Why should there not be, for example, reasoning machines - do we know there is no universal method for reasoning?

Having deeply flawed machines in the sense that they perform their tasks regularly poorly seems like an odd choice to pursue.

Re:Internal representations of LLMs encode information about... by og_kalu on Wednesday October 30, 2024 @04:56PM (#42000201)
What is a reasoning machine though ? And why is there an assumption that one can exist without flaws? It's not like any of the natural examples exist this way. How would you even navigate the real world without the flexibility to make mistakes ? I'm not saying people shouldn't try but you need to be practical. I'll take the General Intelligence with flaws over the fictional one without any day.

>Having deeply flawed machines in the sense that they perform their tasks regularly poorly seems like an odd choice to pursue.

State of the art ANNs are generally mostly right though. Even LLMs are mostly right, that's why hallucinations are particularly annoying.

Re:Internal representations of LLMs encode information about... by RandomLensman on Wednesday October 30, 2024 @06:26PM (#42001189)
Not my usage experience with LLMs. But that aside, poorly performing general intelligence might just not be very valuable compared to highly performing narrow or even zero intelligence.
Re:Internal representations of LLMs encode information about... by og_kalu on Wednesday October 30, 2024 @07:17PM (#42001621)
Well LLMs are very useful and valuable to me and many others today so it's not really a hypothetical future. I'm very glad they exist and there's no narrow intelligence available that is a sufficient substitute.
Re:Internal representations of LLMs encode information about... by RandomLensman on Thursday October 31, 2024 @05:10AM (#42004809)
Not disputing that, but still think as far as reasoning or thinking machines are concerned it is a dead end.
Re:Internal representations of LLMs encode information about... by og_kalu on Thursday October 31, 2024 @12:17PM (#42008353)
I see. Well as far as I'm concerned, they already reason with the standards we apply to ourselves.

People do seem to have higher standards for machines but you can't eat your cake and have it. You can't call what you do reasoning and turn around and call the same thing something else because of preconceived notions of what "true" reasoning should be.