News for hackers. Stuff that matters.

A comment on Transformers Can Do Arithmetic with the Right Embeddings. Parent comment

Re:Transformers Can Do Arithmetic with the Right Embeddings by PartiallyTyped on Tuesday May 28, 2024 @03:04PM (#40504295)
There were some recent posts (either here or reddit) supporting the claim that different regions activate when reading programs vs when reading text. If we take that to be true; and squint just enough, one could claim that arithmetic and mathematics should be treated differently to language.
[ Parent | on HN ]
Re:Transformers Can Do Arithmetic with the Right Embeddings by ckemere on Tuesday May 28, 2024 @04:37PM (#40505357)
Numeracy is definitely associated with different brain regions than just reading. See, e.g. https://www.sciencedirect.com/science/article/pii/S105381191...

(Dehaene also has a book, “The Numbet Sense”)

[ Parent | on HN ]