News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by xanderlewis on Wednesday April 17, 2024 @04:24PM (#40069685)
Probably the fact that even ten years ago one could hope to do something impressive (and maybe even state of the art) with a custom-built model running on a laptop... these days anything you might try is likely to be outdone by a more general model.

Like the fact that all sorts of fun but elementary language processing tasks that previously required some clever engineering or at least careful data collection and a custom-built model can just be done (and done much better) by something like GPT-x. There's far less incentive to play around with basic ML stuff as an amateur now.

There are no comments on this comment yet.