News for hackers. Stuff that matters.

A comment on I'm Not Convinced the AI Bubble Exists. Parent comment

Re:I'm Not Convinced the AI Bubble Exists by bowsamic on Monday November 09, 2026 @03:09AM (#50422567)
A theoretically perfect next token prediction machine is just an LLM with a temperature of 0, which performs worse than one with a non-zero temperature (i.e. imperfection)

The "prediction" has nothing to do with predicting the future, it just means choosing the most likely next token for existing human text

[ Parent | on HN ]
Re:I'm Not Convinced the AI Bubble Exists by Ohentis on Tuesday November 10, 2026 @12:55AM (#50436611)
No that would be a pretty terrible next token predictor. It would perfectly match the training data, but the training data is just a sample of what we are really trying to predict: human language, knowledge, and thinking, which is inherently probabilistic. Perfectly matching the training data is a pretty good sign that you've overfit.
[ Parent | on HN ]