News for hackers. Stuff that matters.

A comment on Do we understand how neural networks work?. Parent comment

Re:Do we understand how neural networks work? by astrange on Thursday August 14, 2025 @08:03AM (#44899413)
The text returned by the tool itself makes it not "next token prediction". Aside from having side effects, the reason it's helpful is that it's out of distribution for the model. So it changes the properties of the system.
[ Parent | on HN ]
Re:Do we understand how neural networks work? by porridgeraisin on Thursday August 14, 2025 @08:12AM (#44899466)
Ah ok, understood what you meant.
[ Parent | on HN ]
Re:Do we understand how neural networks work? by SEGyges on Friday August 15, 2025 @08:03PM (#44918649)
This is true of the system as a whole, but the core neural network is still a next-token predictor.
[ Parent | on HN ]