Re:Is the reversal curse in LLMs real?
by cryptoz on Tuesday November 14, 2023 @11:04PM
(#38273230)
The correct sentence would start with a capital letter: “Red is an apple.” This is also completely valid as in a cartoon character of an apple named Red. The subject being the start of the sentence compounds the uncertainty in meaning.
[ Parent
| on HN ]
Re:Is the reversal curse in LLMs real?
by tysam_and on Tuesday November 14, 2023 @11:15PM
(#38273290)
Yes, this is because there's no assignment happening up front w.r.t. the word 'red'. However, you'll notice the same kind of ambiguity for the word 'apple' in the reversed sentence, as the word 'The' can imply quite a few things following it.
The entropy gotta get slung around somehow.