Re:RedPajama (Open LLaMA Replication) 3B and 7B models released
by wongarsu on Friday May 05, 2023 @09:04PM
(#35836958)
Sure, a 13B model can be fine-tuned to be pretty decent, which is quite remarkable compared to GPT3's 175B paramters. But a 3B model has 1/4th as many parameters as Vicune-13B, or about twice as many as GPT2. Can you really fine-tune that to do anything useful that wouldn't be better handled by a more specialized open-source model?
[ Parent
| on HN ]
There are no comments on this comment yet.