Re:OPT: Open Pre-trained Transformer Language Models
by rdedev on Tuesday May 03, 2022 @12:36AM
(#31244668)
I'm afraid of companies pushing large scale models as the end all for anything text related. Large language models are revolutionary but the last thing I want to see is everything being run through an API. I'm more interested in things like knowledge distillation or prompt tuning. The hope is that a medium size model with some training can match a large one large one using zero shot approaches
[ Parent
| on HN ]
There are no comments on this comment yet.