News for hackers. Stuff that matters.
Re:Is the reversal curse in LLMs real? by earthboundkid on Tuesday November 14, 2023 @08:37PM (#38272304)
Ideally, the LLM would be able to tell the is of identity from the is of predication. I found the article a little too defensive. It felt like "of course it doesn't work, there's not enough data!" and okay, sure, but that is a flaw, no?
Re:Is the reversal curse in LLMs real? by og_kalu on Tuesday November 14, 2023 @08:40PM (#38272321)
Well the LLM can tell in that reversal works just fine in-context. This is a recall from training issue and training is dumb.