News for hackers. Stuff that matters.
Re:OPT: Open Pre-trained Transformer Language Models by rdedev on Tuesday May 03, 2022 @12:36AM (#31244668)
I'm afraid of companies pushing large scale models as the end all for anything text related. Large language models are revolutionary but the last thing I want to see is everything being run through an API. I'm more interested in things like knowledge distillation or prompt tuning. The hope is that a medium size model with some training can match a large one large one using zero shot approaches

There are no comments on this comment yet.