News for hackers. Stuff that matters.
Re:Facebook LLAMA is being openly distributed via torrents by eigenvalue on Friday March 03, 2023 @12:55PM (#35012907)
Weights are more valuable to random individuals who want to mess around with the model. Training code is more valuable to other companies that have the resources to use them, because then they can tweak/modify however they want. But even then, you still need the training data, which in the case of OpenAI and DeepMind is a big part of the secret sauce (not just the raw data but also the process for cleansing and de-duplicating it).

There are no comments on this comment yet.