Re:RedPajama: Reproduction of Llama with Friendly License (S...
by Tepix on Tuesday April 18, 2023 @11:12AM
(#35615059)
Not all use cases need GPT-4 level performance. I'd argue that even LLaMA-7B is quite limited. Also, new and improved models are being released all the time.
Pythia 13B is worse than LLaMA-7B and requires double the resources.