Re:Is the reversal curse in LLMs real?
by thfuran on Wednesday November 15, 2023 @04:23AM
(#38274820)
>it's an autoregressive feature based on the entire stream of incoming tokens. Humans have a bias to focus on the 'last token used', this is not what language models look at.
But human language is created for and by humans. Is not then operating on language in a categorically different manner an incorrect usage/understanding of language?
Re:Is the reversal curse in LLMs real?
by tysam_and on Wednesday November 15, 2023 @03:06PM
(#38281708)
No.
For more information, please see https://people.math.harvard.edu/~ctm/home/text/others/shanno...
Re:Is the reversal curse in LLMs real?
by thfuran on Thursday November 16, 2023 @05:34AM
(#38287882)
I'm not sure why you think that's a rebuttal.
Re:Is the reversal curse in LLMs real?
by tysam_and on Thursday November 16, 2023 @05:55AM
(#38288048)
It is because it is the foundation for the mathematics underpinning your question about communications systems, encodings, and their various structures. It also explains why the choice of the log likelihood is a better fit for estimating a token-based model than some other hand-crafted heuristic.
The version with the Weaver introduction is quite good as well, there are other versions of similar papers covering the topic from different angles, I find it to be well-worth the read.
Best to simply scale log-likelihood-based training, next-token-based training trivially contains a requirement for learning all of the subproblems that predict said, next token, and hardcoding something to get warm human fuzzies would be creating a biased estimator (and move us back towards the 90s a bit).
Models already very constantly do context-dependent token utilization, it's an autoregressive feature based on the entire stream of incoming tokens. Humans have a bias to focus on the 'last token used', this is not what language models look at.