News for hackers. Stuff that matters.
Re:Large Language Models' Emergent Abilities Are a Mirage by CamperBob2 on Monday March 25, 2024 @01:42AM (#39813112)
Arithmetic is treated as a proxy for general reasoning abilities.

Which is stupid, because it's not. A pocket calculator can perform arithmetic, as can a Python program, or for that matter a Japanese cormorant, who counts the fish it helps you catch. None of those are considered capable of "reasoning" on their own.

Meanwhile, GPT4 will cheerfully write a program to carry out the required arithmetic operations (and then some.) A study that doesn't acknowledge that is worthless at best.

Re:Large Language Models' Emergent Abilities Are a Mirage by Jensson on Monday March 25, 2024 @04:23AM (#39813832)
> Meanwhile, GPT4 will cheerfully write a program to carry out the required arithmetic operations (and then some.) A study that doesn't acknowledge that is worthless at best.

We don't want to see if the LLM can be used as a tool to do arithmetics, but whether it can learn complex data relationships like arithmetics. Arithmetics is a stepping stone, not a goal so that the model can solve it by invoking a calculator isn't relevant. The problems we want it to solve doesn't have tools like calculators so it doesn't help getting us there.

Re:Large Language Models' Emergent Abilities Are a Mirage by naasking on Monday March 25, 2024 @08:43AM (#39815604)
Exactly, because as Godel showed, aritmhmetic can in principle model mnany other formal systems, so if you can see arithmetic examples and generalize to the full set of rules and learn to apply them consistently, then you have a powerful reasoning tool.
Re:Large Language Models' Emergent Abilities Are a Mirage by imtringued on Monday March 25, 2024 @06:23AM (#39814467)
These models are clearly capable of doing this. There is no theoretical reason why you should expect them to to fail at this. One day they will be able to do this perfectly and nobody gets the silly idea of generating a program to do it anymore. There is no need for another bitter lesson where "clever" AI researchers and engineers waste their career adding a hundred different workarounds to these minor problems.
Re:Large Language Models' Emergent Abilities Are a Mirage by CamperBob2 on Monday March 25, 2024 @12:25PM (#39818257)
I don't know... the ability to write code to solve an otherwise ill-suited problem seems pretty general to me. It seems like a big step in a concrete direction, as opposed to a lot of Goedelian navel-gazing about arithmetic and Peano axioms and whatnot.

Agreed that generalized architectures will ultimately win out over hand-tweaked ones. But the patent wars that will eventually be fought over this stuff are where the real bitter lessons will come into play. At some point, we'll be forced back into the hand-optimization business because someone like OpenAI (or another Microsoft proxy) will have locked down a lot of powerful basic techniques.