News for hackers. Stuff that matters.
Re:Transformers Can Do Arithmetic with the Right Embeddings by anon291 on Tuesday May 28, 2024 @09:08AM (#40500388)
I must be in the minority here, but I don't think most people exercise any reason. I'd even venture that the vast majority of people haven't reasoned recently at all. In my mind, reasoning is an ability... a willful act to engage in thinking through an abstract problem. Most people don't do this and just use rationalization and learned behavior, which our brains are good at.
Re:Transformers Can Do Arithmetic with the Right Embeddings by HarHarVeryFunny on Tuesday May 28, 2024 @10:17AM (#40500972)
I think for the most part that's true, but obviously there are things people want to use LLMs for that do require planning/reasoning, and it makes for unexpected failure modes if LLMs don't have this ability.
Re:Transformers Can Do Arithmetic with the Right Embeddings by short_sells_poo on Tuesday May 28, 2024 @10:14AM (#40500948)
Well, 99% of day to day life is mundane for much of living beings on earth. A bee is able to get through it's entire life without showing signs that it deeply ponders about anything.

However, humans have the ability to reason about things (whether most people use this ability is a different question). So then we must ask the question: is this ability just a more advanced form of probabilistic pattern matching, or is it a different architecture altogether? Will current AI models be able to develop this ability, or will we need new models?

Re:Transformers Can Do Arithmetic with the Right Embeddings by ckemere on Tuesday May 28, 2024 @04:49PM (#40505464)
People do inference all the time. “Is that driver about to turn?” “Where is the water next to the faucet coming from?” “Does this person like me?”