News for hackers. Stuff that matters.
Re:Understanding the Limitations of Mathematical Reasoning i... by hggigg on Friday October 11, 2024 @05:36PM (#41814006)
So, what exactly is the point of the LLM if it can't exceed an average person and produces results which are not trustworthy?
Re:Understanding the Limitations of Mathematical Reasoning i... by HeatrayEnjoyer on Saturday October 12, 2024 @02:29AM (#41816930)
"The average person" has a job. Those jobs can now be performed by machine. The societal implications are profound.
Re:Understanding the Limitations of Mathematical Reasoning i... by rafaelmn on Saturday October 12, 2024 @06:08AM (#41817987)
If those jobs consisted of solving small isolated puzzles and math questions you'd maybe have a point.

The societal impact so far has been mostly increasing noise (generating irrelevant content you have to filter out) and burning resources.

Fundamentally AI models need a better way to learn and use memory if they want to replace entry level human jobs - RAG and fine tuning ain't it.

Re:Understanding the Limitations of Mathematical Reasoning i... by echoangle on Saturday October 12, 2024 @07:00AM (#41818215)
The "average Person" which struggles with the given questions probably has a physical work job though.
Re:Understanding the Limitations of Mathematical Reasoning i... by pornel on Saturday October 12, 2024 @10:15AM (#41819226)
I think it's necessary to remember that they're not a general artificial intelligence, but language models. For example, they're pretty good (not perfect) at translating things, including translating arbitrary instructions into code or machine-readable forms.