GPT-4o's Memory Breakthrough (Needle in a Needlestack)

Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack) by dkjaudyeqooe on Wednesday May 15, 2024 @05:41AM (#40364848)

That fact that it has some statistically significant performance is irrelevant and difficult to evaluate for most people.

He's a much simpler and correct description that almost everyone can understand: it fucks up constantly.

Getting something wrong even once can make it useless for most people. No amount of pedantry will change this reality.

[ Parent | on HN ]

Re:GPT-4o's Memory Breakthrough (Needle in a Needlestack) by davedx on Wednesday May 15, 2024 @08:24AM (#40365982)

What on earth? The experimental research demonstrates that it doesn't "fuck up constantly", you're just making things up. The various performance metrics people around the world to measure and compare model performance is not irrelevant because you, some random internet commenter, claim so without any evidence.

This isn't pedantry, it's science.

[ Parent | on HN ]