News for hackers. Stuff that matters.
Re:The Collapse of GPT by meowkit on Friday May 16, 2025 @11:27PM (#44011814)
> Once we have a universal automated judge that can judge any kind of human research output then sure your statement is true,

If you've noticed, most LLM interfaces have a "thumbs up" or "thumbs down" response. The prompt may provide novel data. The text generated is synthetic. You don't need an automated judge, the user is providing sufficient feedback.

Same thing goes for the other disciplines.

Re:The Collapse of GPT by didericis on Saturday May 17, 2025 @12:54AM (#44012124)
I’m extremely skeptical that “thumbs up” and “thumbs down” plus replies to chatbots is sufficiently informative to train models to the same level of quality as models trained on user generated content.