News for hackers. Stuff that matters.
Re:A Knockout Blow for LLMs? by nantersand on Sunday June 08, 2025 @04:08AM (#44215487)
The paper shows reasoning is better than no reasoning, reasoning needs more tokens to work for simple tasks, and that models get confused when things get too complicated. Nothing interesting, on the level of what an undergrad would write for a side project. If it wasn’t “from apple” no one would be mentioning it.
Re:A Knockout Blow for LLMs? by nantersand on Sunday June 08, 2025 @04:12AM (#44215496)
They cite https://arxiv.org/abs/2503.23829 which is interesting though. If you have lots of tokens to burn, just try the task lots of times. Can find better solutions than reasoning would on its first try. Only tested on small models though.
Re:A Knockout Blow for LLMs? by 081guy on Sunday June 08, 2025 @04:11AM (#44215494)
I think that these kind of papers are necessary to ground people back into reality - the hype machine is too strong to be left unguarded.
Re:A Knockout Blow for LLMs? by nantersand on Sunday June 08, 2025 @04:14AM (#44215509)
All the papers I’ve seen show models have limits. This is just an attention grab by lazy “researchers” cashing in on their Apple credentials.
Re:A Knockout Blow for LLMs? by threeseed on Sunday June 08, 2025 @04:25AM (#44215562)
Samy Bengio is the co-author of Torch. His credentials speak for themselves.