Re:Understanding the Limitations of Mathematical Reasoning i...
by hggigg on Friday October 11, 2024 @05:36PM
(#41814006)
So, what exactly is the point of the LLM if it can't exceed an average person and produces results which are not trustworthy?
Re:Understanding the Limitations of Mathematical Reasoning i...
by HeatrayEnjoyer on Saturday October 12, 2024 @02:29AM
(#41816930)
"The average person" has a job. Those jobs can now be performed by machine. The societal implications are profound.
Re:Understanding the Limitations of Mathematical Reasoning i...
by rafaelmn on Saturday October 12, 2024 @06:08AM
(#41817987)
If those jobs consisted of solving small isolated puzzles and math questions you'd maybe have a point.
The societal impact so far has been mostly increasing noise (generating irrelevant content you have to filter out) and burning resources.
Fundamentally AI models need a better way to learn and use memory if they want to replace entry level human jobs - RAG and fine tuning ain't it.
Re:Understanding the Limitations of Mathematical Reasoning i...
by echoangle on Saturday October 12, 2024 @07:00AM
(#41818215)
The "average Person" which struggles with the given questions probably has a physical work job though.
Re:Understanding the Limitations of Mathematical Reasoning i...
by pornel on Saturday October 12, 2024 @10:15AM
(#41819226)
I think it's necessary to remember that they're not a general artificial intelligence, but language models. For example, they're pretty good (not perfect) at translating things, including translating arbitrary instructions into code or machine-readable forms.
Re:Understanding the Limitations of Mathematical Reasoning i...
by buneskamin on Sunday October 13, 2024 @12:44AM
(#41825218)
Seriously? those are pretty simple HS math questions, I find it a bit hard to believe most average people cant solve them. Don't most people graduate HS?
For deterministic calculations you obviously want to allow LLMs to use tools to do math. Just like you’d want to allow humans to use calculators.
So yeah, you shouldn’t ask LLMs to do math just like you shouldn’t ask average people to do math. They both suck at it.