News for hackers. Stuff that matters.
Re:RedPajama 7B (an Apache 2.0-licensed LLaMa) is now available by anon373839 on Tuesday June 06, 2023 @07:05PM (#36220319)
> a base for fine-tuning a task specific model

Yes. The 7B size can perform very well when tuned on a specific menu of tasks:

1. Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic Tasks

https://huggingface.co/papers/2305.14201

2. Gorilla: Large Language Model Connected with Massive APIs

https://arxiv.org/abs/2305.15334

There are no comments on this comment yet.