Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on What does it mean when an LLM “hallucinates” & why do LLMs hallucinate?. Parent comment
This article isn't doing that, though. What it is calling the model objective is "producing clear and coherent text".
> Whether "producing clear and coherent text" is a good characterisation of a "predict the next token" loss function is another question though.
I agree. But lets us be clear that prediction too is a misnomer. Simply generating a word coherent with prior words is not prediction.
There are no comments on this comment yet.
This article isn't doing that, though. What it is calling the model objective is "producing clear and coherent text".
> Whether "producing clear and coherent text" is a good characterisation of a "predict the next token" loss function is another question though.
I agree. But lets us be clear that prediction too is a misnomer. Simply generating a word coherent with prior words is not prediction.