Re:Transformers Can Do Arithmetic with the Right Embeddings
by nprateem on Tuesday May 28, 2024 @02:55PM
(#40504170)
Exactly
[ Parent
| on HN ]
Re:Transformers Can Do Arithmetic with the Right Embeddings
by vidarh on Tuesday May 28, 2024 @03:24PM
(#40504537)
The point is don't ask an LLM to do tasks that a calculator can do. Ask if to use the calculator, just like most humans would.
Re:Transformers Can Do Arithmetic with the Right Embeddings
by chowells on Tuesday May 28, 2024 @04:23PM
(#40505199)
The point is that you shouldn't need to ask. If it's actually a general-purpose system it will do it automatically.
Re:Transformers Can Do Arithmetic with the Right Embeddings
by vidarh on Tuesday May 28, 2024 @08:12PM
(#40506900)
An LLM in isolation is not a general purpose system, but with ChatGPT at least, most of the time you don't need to ask. In fact, it's increasingly difficult to force it to do "manual" maths, as it's strongly predisposed to do things like write and evaluate Python code instead of doing it "manually".
E.g. I verified just now and asked it to multiply two huge numbers, and it immediately spat out Python code, then evaluated it and gave me the result, rather than try to add the numbers itself.