News for hackers. Stuff that matters.

A comment on OpenAI Progress. Parent comment

Re:OpenAI Progress by collingreen on Saturday August 16, 2025 @01:23PM (#44925319)
Without some exploratory fact checking how do you estimate how high the accuracy is and how often you should be fact checking to maintain a good understanding?
[ Parent | on HN ]
Re:OpenAI Progress by simianwords on Saturday August 16, 2025 @04:07PM (#44926519)
I did initial tests so that I don't have to do it anymore.
[ Parent | on HN ]
Re:OpenAI Progress by malfist on Saturday August 16, 2025 @04:22PM (#44926613)
If there's one thing that's constant it's that these systems change.
[ Parent | on HN ]
Re:OpenAI Progress by jibal on Saturday August 16, 2025 @10:33PM (#44928440)
Everyone else has done tests that indicate that you do.
[ Parent | on HN ]
Re:OpenAI Progress by glenstein on Sunday August 17, 2025 @06:51AM (#44930639)
And this is why you can't use personal anecdotes to settle questions of software performance.

Comment sections are never good at being accountable for how vibes-driven they are when selecting which anecdotes to prefer.

[ Parent | on HN ]