Re:Collapse of Self-Trained Language Models
by xanderlewis on Wednesday April 17, 2024 @04:24PM
(#40069685)
Probably the fact that even ten years ago one could hope to do something impressive (and maybe even state of the art) with a custom-built model running on a laptop... these days anything you might try is likely to be outdone by a more general model.
Like the fact that all sorts of fun but elementary language processing tasks that previously required some clever engineering or at least careful data collection and a custom-built model can just be done (and done much better) by something like GPT-x. There's far less incentive to play around with basic ML stuff as an amateur now.
Like the fact that all sorts of fun but elementary language processing tasks that previously required some clever engineering or at least careful data collection and a custom-built model can just be done (and done much better) by something like GPT-x. There's far less incentive to play around with basic ML stuff as an amateur now.