News for hackers. Stuff that matters.
Re:Meta rolls out AI language model LLaMA by p1esk on Friday February 24, 2023 @07:18PM (#34932215)
Did you even look at the repo before commenting? The model code is literally open source: https://github.com/facebookresearch/llama/blob/main/llama/mo...

Even the checkpoints are provided - for free! All you have to do is ask.

Someone at Facebook spent a ton of money to train a state of the art model, open sourced the code and even provides checkpoints free of charge, and you still complain? The level of entitlement is off the charts…

Re:Meta rolls out AI language model LLaMA by kaoD on Friday February 24, 2023 @07:29PM (#34932301)
> All you have to do is ask.

That makes it literally not open source. Can I redistribute it freely? I don't think so, I might be wrong. If not, it's not open source.

> and you still complain?

But I don't complain about Facebook releasing it in whichever terms they want. I complain that people call it open source when it clearly isn't.

> The level of entitlement is off the charts…

How is pointing that it's not open source entitlement?

Re:Meta rolls out AI language model LLaMA by p1esk on Friday February 24, 2023 @07:53PM (#34932487)
Again, I have to point you to the repo code. Here’s the licence: https://github.com/facebookresearch/llama/blob/main/LICENSE

The model code is literally open source. Provided and licensed.

Re:Meta rolls out AI language model LLaMA by throwaway1851 on Saturday February 25, 2023 @05:48AM (#34935611)
The disconnect here is that the model code isn’t the important part. If you read the paper, LLaMA is all about the training data and the training process (which required a ”massive quantity” of compute, to quote the paper). Without releasing the significant part of their work, what are they really releasing?
Re:Meta rolls out AI language model LLaMA by p1esk on Saturday February 25, 2023 @09:46AM (#34937054)
Exactly - massive amount of compute required to reproduce the training process, and that’s why almost no one is going to try training this model from scratch. Most people will use this model as is, and a small number of people will finetune it on their own data - those people most likely already have their own training scripts, because finetuning is much easier than training from scratch and requires different hyper parameters.

I don’t know why they haven’t released the training code - I agree it would be nice if they did - but the important thing here is they created something valuable, open sourced it, and even provided model weights - for free. Let’s appreciate it.

Even if they did publish their training code - that’s not enough to train the model. You also need their dataset. Would you still claim “the model is not open source” because the dataset is not available?

Bottom line: the model has been open sourced. The training code hasn’t - and isn’t needed by most users of this model.

Re:Meta rolls out AI language model LLaMA by kaoD on Saturday February 25, 2023 @10:39AM (#34937435)
> You also need their dataset.

With the training code you can fine tune the model with your own dataset, which exactly fits FSF's freedom 1.

Re:Meta rolls out AI language model LLaMA by rnd0 on Saturday February 25, 2023 @02:29AM (#34934685)
>I might be wrong. If not, it's not open source.

It isn't "Free Software" if it doesn't allow for the four freedoms -including the right to modify and redistribute your modifications.

As a term, "open source" is ambiguous to almost having almost no actual meaning at all. But "Free Software" has a concrete meaning and if you can't redistribute something then it is not "Free Software".

Hope that helps.

Edit to add a citation: https://fsfe.org/freesoftware/

Re:Meta rolls out AI language model LLaMA by kaoD on Saturday February 25, 2023 @05:37AM (#34935558)
I know what free software is. I meant the checkpoint might be redistributable after you ask for it (but I doubt so).

Open Source has a clear and specific definition BTW: https://opensource.org/osd/