Re:Is the reversal curse in LLMs real?
by thfuran on Thursday November 16, 2023 @05:34AM
(#38287882)
I'm not sure why you think that's a rebuttal.
Re:Is the reversal curse in LLMs real?
by tysam_and on Thursday November 16, 2023 @05:55AM
(#38288048)
It is because it is the foundation for the mathematics underpinning your question about communications systems, encodings, and their various structures. It also explains why the choice of the log likelihood is a better fit for estimating a token-based model than some other hand-crafted heuristic.
The version with the Weaver introduction is quite good as well, there are other versions of similar papers covering the topic from different angles, I find it to be well-worth the read.
For more information, please see https://people.math.harvard.edu/~ctm/home/text/others/shanno...