Re:Weak-to-Strong Generalization
by jakderrida on Friday December 15, 2023 @08:31PM
(#38660932)
> But it doesn't know how to get the letter R in blueberry since the composition of the above two actions isn't in its training set, hence it reliably fails such questions.
Me
what is the seventh letter in the word "blueberry"?
ChatGPT
The seventh letter in the word "blueberry" is "r".
Me
what is the seventh letter in the word "blueberry"?
ChatGPT
The seventh letter in the word "blueberry" is "r".