News for hackers. Stuff that matters.
Re:Is the reversal curse in LLMs real? by tysam_and on Wednesday November 15, 2023 @03:06PM (#38281708)
Re:Is the reversal curse in LLMs real? by thfuran on Thursday November 16, 2023 @05:34AM (#38287882)
I'm not sure why you think that's a rebuttal.
Re:Is the reversal curse in LLMs real? by tysam_and on Thursday November 16, 2023 @05:55AM (#38288048)
It is because it is the foundation for the mathematics underpinning your question about communications systems, encodings, and their various structures. It also explains why the choice of the log likelihood is a better fit for estimating a token-based model than some other hand-crafted heuristic.

The version with the Weaver introduction is quite good as well, there are other versions of similar papers covering the topic from different angles, I find it to be well-worth the read.