News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by barfbagginus on Wednesday April 17, 2024 @05:13PM (#40070091)
Don't worry about the copers. Just be ready for people who

1. Think this research is pointless because of course stochastic parrots would exhibit knowledge collapse

2. Use this research to argue more advanced models will always have knowledge collapse, even if grounded in empirical data

These are not bad signs. They are screening signals that let you tell when someone has no genuine interest in uncovering the truth of the matter. That is very useful to know, since otherwise you will waste time trying to get useful contributions out of them, which is beyond frustrating.

There are no comments on this comment yet.