News for hackers. Stuff that matters.
Re:Is the reversal curse in LLMs real? by TeMPOraL on Wednesday November 15, 2023 @03:49AM (#38274625)
True, but only in the implicit, very narrow world typically assumed when doing logic exercises. "Red is the apple", obviously, because our whole world consists of "The apple is red" and some inference rules. In that world, "Red is the" can only be completed by "apple". Drop the narrowing though, and suddenly there's a lot of other completions, many of them much better ones (I'd guess "blood" will be one of the more frequent ones - "red is the blood of" shows up a lot in songs and poems).

Or in short: LLMs will handle "The apple is red. Red is the " just fine, because the first part is heavily biasing the answer. They won't often complete "Red is the " alone with "apple", because why should they?

There are no comments on this comment yet.