Re:Senators send letter questioning Mark Zuckerberg over Met...
by ozr on Thursday June 08, 2023 @11:13AM
(#36243234)
This feels like the slowpoke meme; there are many other equally-capable foundation models in the wild now. And even if there wasn't, DJB vs US established source code as speech. I'd strongly prefer to not see the federal government investigating speech.
[ Parent
| on HN ]
Re:Senators send letter questioning Mark Zuckerberg over Met...
by r00fus on Thursday June 08, 2023 @11:16AM
(#36243302)
Don't most of them have llama as their origin/basis? Which ones are independent completely?
Re:Senators send letter questioning Mark Zuckerberg over Met...
by ozr on Thursday June 08, 2023 @11:33AM
(#36243618)
There are tons of models that either LoRA or finetune LLaMA, but I meant foundational models, i.e., ones completely distinct from LLaMA. That includes Falcon, MPT, StableLM, StarCoder, Replit Code, CodeGen.
There's also RedPajama and OpenLLaMA, which are intended to give similar performance to LLaMA but be legally distinct.