News for hackers. Stuff that matters.
Re:Facebook is aggressively going after LLaMA repos with DMCA's by danieldk on Friday March 24, 2023 @11:03AM (#35289953)
IANAL, so this is not legal advise. I consulted a legal expert a few years ago about the status of machine learning models and they said it is really unclear. Apparently, if works are transformed enough that the original is not recognizable anymore it may not violate copyright. It hinges a lot on whether the original work is reproduced, so if you could get an LLM to spit out copyrighted texts unmodified, then it would most likely be copyright violation. But I think that doesn't really happen much in practice.

On the other hand, Meta can have copyright over the model through 'copyright in compilation', which protects the work of compiling work in a coordinated or creative way, regardless of the copyright of the underlying material.

So, I fear that it may be possible to have it both ways. But realistically, I think we'll only know for sure when this is fought out in court.

Disclaimer: again I am not a lawyer, so take this with a grain of salt.

Re:Facebook is aggressively going after LLaMA repos with DMCA's by feanaro on Friday March 24, 2023 @11:38AM (#35290510)
Even if this interpretation is correct, it only holds if the law is not changed. But the law is not immutable.

My proclamation could be considered to be in terms of what ought to be, in order for society to be just and to prevent a disproportionate accumulation of power in ultra large corporations, which is detrimental to society.

Re:Facebook is aggressively going after LLaMA repos with DMCA's by danieldk on Friday March 24, 2023 @11:46AM (#35290642)
Well that's not the way you stated. But I completely agree that that's the way it ought to be.
Re:Facebook is aggressively going after LLaMA repos with DMCA's by A1kmm on Saturday March 25, 2023 @06:52AM (#35301388)
You could also imagine a battle over something that started with LLaMa, but fine-tuned it using a non-spare method (i.e. changed every single parameter) so it was very marginally altered in its behaviour.

Even if the base model is copyrightable (possibly a big if), there is a valid question of whether a new model which essentially optimised for something else, but used the base model as a computational shortcut to make it far cheaper to solve an optimisation problem, is still protected by the copyright holder of the base model.

Most of the barrier to creating large language models is the computational cost of training, not coming up with the training set data, so if fine-tuning gets around the copyright issues and allows for better FLOSS-licenced fine-tuned models, that would probably be a good thing (although maybe it will decrease the willingness of companies doing training to release models at all).