News for hackers. Stuff that matters.

A comment on Understanding the Limitations of Mathematical Reasoning in Large Language Models. Parent comment

Re:Understanding the Limitations of Mathematical Reasoning i... by mdp2021 on Friday October 11, 2024 @04:54PM (#41813638)
> LLMs have dramatically worse performance on basic algebra questions when you add in irrelevant information

"Attention is all you need" /

(It is part of the general problem solving process to evaluate what is relevant and what is not.)

[ Parent | on HN ]
Re:Understanding the Limitations of Mathematical Reasoning i... by moffkalast on Friday October 11, 2024 @06:53PM (#41814665)
Differential attention that filters out noise is all you need :)
[ Parent | on HN ]