News for hackers. Stuff that matters.
Re:Transformers Can Do Arithmetic with the Right Embeddings by catapart on Tuesday May 28, 2024 @10:09AM (#40500909)
I'm with you. I get that this is akin to asking a human, because we're trying to reason, so we will bring along (assumedly) unavoidable deficiencies of human reasoning. But if I were to ask a human genius this question, ne would grab a calculator and employ it as ne did the rest of ner reasoning.

So it seems like we should probably teach LLMs to "use a calculator", rather than try to get them to be more right when doing math 'in their head'.

Re:Transformers Can Do Arithmetic with the Right Embeddings by naasking on Tuesday May 28, 2024 @11:09AM (#40501447)
Indeed, "use a calculator" is "just a trick"!