Re:Weak-to-Strong Generalization
by jakderrida on Friday December 15, 2023 @08:31PM
(#38660932)
> But it doesn't know how to get the letter R in blueberry since the composition of the above two actions isn't in its training set, hence it reliably fails such questions.
Me
what is the seventh letter in the word "blueberry"?
ChatGPT
The seventh letter in the word "blueberry" is "r".
That proves in general these LLMs can't compose knowledge, unless it has seem a lot of examples of similar compositions before. That is a massive problem and why I believe LLMs will never reach AGI, you need something more.