News for hackers. Stuff that matters.
Re:Better and Faster Large Language Models via Multi-Token P... by hiddencost on Wednesday May 01, 2024 @09:55AM (#40223305)
It's called the Markov assumption. It was basically the single most important piece of mathematics in the field for decades. It allowed us to solve otherwise intractable problems given the limited compute budgets of the time.
Re:Better and Faster Large Language Models via Multi-Token P... by Xcelerate on Wednesday May 01, 2024 @10:00AM (#40223366)
Sure, and it's probably the wrong assumption to make in this case if our eventual goal is to capture general reasoning ability via LLMs.