Re:Collapse of Self-Trained Language Models
by bee_rider on Wednesday April 17, 2024 @03:08PM
(#40068876)
People don’t learn based on the action they just did, they learn based on the universe’s response to that action. It seems like an expected result that if the model is just learning by inserting it’s outputs into the training data somehow, that it will fail, in the same way that a person who never receives feedback will go in really weird directions.
But the paper is nice to have in case anyone is suggesting such a scheme. Is anyone? Hopefully not…
But the paper is nice to have in case anyone is suggesting such a scheme. Is anyone? Hopefully not…