Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack)
by sftombu on Tuesday May 14, 2024 @04:55PM
(#40360051)
If you ask the questions without providing the limerick first, it never gets the right answer. When the LLM gets the wrong answer, it is usually because it reverts to its training data and gives a generic answer that doesn't apply to the limerick.
[ Parent
| on HN ]
Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack)
by trifurcate on Tuesday May 14, 2024 @10:24PM
(#40362450)
Why are you ruling out the possibility that training on the material may confer an advantage when the data is presented, even if the advantage may not be strong enough to pass the test without the data present in the context window?