News for hackers. Stuff that matters.
Re:Senators send letter questioning Mark Zuckerberg over Met... by r00fus on Thursday June 08, 2023 @11:16AM (#36243302)
Don't most of them have llama as their origin/basis? Which ones are independent completely?
Re:Senators send letter questioning Mark Zuckerberg over Met... by ozr on Thursday June 08, 2023 @11:33AM (#36243618)
There are tons of models that either LoRA or finetune LLaMA, but I meant foundational models, i.e., ones completely distinct from LLaMA. That includes Falcon, MPT, StableLM, StarCoder, Replit Code, CodeGen.

There's also RedPajama and OpenLLaMA, which are intended to give similar performance to LLaMA but be legally distinct.