Re:Stop Thinking of LLMs as Next-Token Predictors
by saghm on Friday September 04, 2026 @03:53PM
(#49569418)
That seems overly pedantic to me. If I asked you "What's your prediction for the Super Bowl?", I'm pretty confident you would infer that I mean predicting the outcome, not the event itself.
[ Parent
| on HN ]
Re:Stop Thinking of LLMs as Next-Token Predictors
by jameshart on Friday September 04, 2026 @05:59PM
(#49570734)
But if you are an NFL coach and I ask you to decide your next action in order to maximize your odds of winning the superbowl, while yes that does involve you having some predictive ability to think about what impact your actions would have on your odds of winning the Super Bowl… I don’t think you would call the process that you use to decide that next action ‘prediction’.
Re:Stop Thinking of LLMs as Next-Token Predictors
by saghm on Friday September 04, 2026 @06:50PM
(#49571120)
I don't find the fact that I don't call any humans "action predictors" to be a particularly meaningful insight because my rationale is that it's a weird thing to call a human; football coaches can do plenty of other things besides just coaching football.
Re:Stop Thinking of LLMs as Next-Token Predictors
by jameshart on Friday September 04, 2026 @07:11PM
(#49571275)
Yep, we’re all just putting one foot in front of the other, hoping we’re doing the right thing to bring about the outcomes we want, trying our best.
But that’s the point: so is an LLM. Putting one token in front of another, hoping it’s doing the right thing to bring about the rewards it’s trained to… trying its best.
So yeah, not ‘next token predictors’. ‘Next token tryers’ maybe.
Re:Stop Thinking of LLMs as Next-Token Predictors
by saghm on Friday September 04, 2026 @11:28PM
(#49572829)
There's a pretty huge difference in our understanding of the methodology of how LLMs make decisions and how humans make decisions, so I don't understand why you're arguing that anything about how humans make decisions is relevant to the terminology we use for LLMs.
Re:Stop Thinking of LLMs as Next-Token Predictors
by danielmarkbruce on Friday September 04, 2026 @07:43PM
(#49571500)
Predict implies you don't control a situation. That's the difference.