News for hackers. Stuff that matters.

A comment on Large Language Models' Emergent Abilities Are a Mirage. Parent comment

Re:Large Language Models' Emergent Abilities Are a Mirage by pixl97 on Monday March 25, 2024 @03:12PM (#39820200)
I mean, is it efficient to teach them addition human style instead of heuristics of when to call the right function?

Imagine you could say 'calc' in your brain, and some separate subcomponent of your brain that is far more power efficient could return an answer almost instantly? You would not focus on understanding addition/subtraction, more you would focus on on when to use addition/subtraction/multiplication or whatever.

[ Parent | on HN ]
Re:Large Language Models' Emergent Abilities Are a Mirage by HarHarVeryFunny on Monday March 25, 2024 @04:12PM (#39820770)
> is it efficient to teach them addition human style

Not if math is your only goal, but there'd be value in making the models more powerful so that they could learn to do simple things like this (and not so simple things) by themselves. You can't have a tool for everything, and hopefully future AGI can itself do things that are more than just a mashup of existing tool capabilities.

[ Parent | on HN ]