Re:John Carmack and Rich Sutton partner to accelerate develo...
by the_other on Saturday October 07, 2023 @09:26AM
(#37801537)
You may write one word at a time but the grammar of most languages forces their users to know what they’re going to write several words ahead of the current word.
[ Parent
| on HN ]
Re:John Carmack and Rich Sutton partner to accelerate develo...
by FrustratedMonky on Saturday October 07, 2023 @11:00AM
(#37802258)
Ok. Why do you think GPT isn't doing that? or is different?
It might be calculating the next word, because you can only write one word at a time, but you can't say that the current next word isn't influenced by a few words ahead. Don't think the current understanding of what LLM's do internally can rule that out.