News for hackers. Stuff that matters.

A comment on GPT-4o's Memory Breakthrough (Needle in a Needlestack). Parent comment

Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack) by causal on Tuesday May 14, 2024 @11:27PM (#40362784)
Yeah I also tried to get it to complete some limericks from the dataset. Curiously it believed it had heard of the limerick but would then recite a hallucination.

So the good news is that the NIAN score might be real, bad news is you can't rely on it to know what it knows.

[ Parent | on HN ]
Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack) by seanhunter on Wednesday May 15, 2024 @02:21PM (#40370524)
If you ask it to complete a limerick and it finishes it differently from the original, but it still works as a limerick is that really a hallucination?
[ Parent | on HN ]