Re:Reasoning Models Reason Well, Until They Don't
by gpderetta on Friday October 31, 2025 @10:57AM
(#45772674)
Indeed, they are next token predictors, but this is a vacuous statement because the predictor can be arbitrary complex.
[ Parent
| on HN ]
Re:Reasoning Models Reason Well, Until They Don't
by HarHarVeryFunny on Friday October 31, 2025 @04:10PM
(#45776178)
Sure, but a complex predictor is still a predictor. It would be a BAD predictor if everything it output was not based on "what would the training data say?".
If you ask it to innovate and come up with something not in it's training data, what do you think it will do .... it'll "look at" it's training data and regurgitate (predict) something labelled as innovative
You can put a reasoning cap on a predictor, but it's still a predictor.