Re:The Collapse of GPT
by meowkit on Friday May 16, 2025 @11:27PM
(#44011814)
> Once we have a universal automated judge that can judge any kind of human research output then sure your statement is true,
If you've noticed, most LLM interfaces have a "thumbs up" or "thumbs down" response. The prompt may provide novel data. The text generated is synthetic. You don't need an automated judge, the user is providing sufficient feedback.
Re:The Collapse of GPT
by didericis on Saturday May 17, 2025 @12:54AM
(#44012124)
I’m extremely skeptical that “thumbs up” and “thumbs down” plus replies to chatbots is sufficiently informative to train models to the same level of quality as models trained on user generated content.
If you've noticed, most LLM interfaces have a "thumbs up" or "thumbs down" response. The prompt may provide novel data. The text generated is synthetic. You don't need an automated judge, the user is providing sufficient feedback.
Same thing goes for the other disciplines.