Re:Better and Faster Large Language Models via Multi-Token P...
by hiddencost on Wednesday May 01, 2024 @09:55AM
(#40223305)
It's called the Markov assumption. It was basically the single most important piece of mathematics in the field for decades. It allowed us to solve otherwise intractable problems given the limited compute budgets of the time.
[ Parent
| on HN ]