News for hackers. Stuff that matters.
Re:Better and Faster Large Language Models via Multi-Token P... by pbh101 on Wednesday May 01, 2024 @07:03AM (#40221700)
The alternative theory is that any word starting with a vowel sound is exceedingly uncommon after ’a’ in its training set, so it doesn’t need to plan ahead, just predict the distribution of the most likely next words and choose.

Which is my understanding of how they work and the dynamic at play.

There are no comments on this comment yet.