Re:Better and Faster Large Language Models via Multi-Token P...
by bjourne on Wednesday May 01, 2024 @06:47AM
(#40221612)
That's hierarchical prediction. On one level you predict the style of the paragraph, on another the tone and form of the sentence, and on the third the next word. However, this form of prediction is quite difficult since predictions from the layers affect each other.
[ Parent
| on HN ]
There are no comments on this comment yet.