Re:OpenAI's justification for why training data is fair use,...
by troupe on Thursday October 05, 2023 @03:38PM
(#37783273)
You are assuming that an LLM is saving a copy of the book it reads.
[ Parent
| on HN ]
Re:OpenAI's justification for why training data is fair use,...
by pclmulqdq on Thursday October 05, 2023 @05:24PM
(#37784477)
LLMs don't read, they are trained. Yes, training involves saving a copy of the training corpus.
Re:OpenAI's justification for why training data is fair use,...
by denton-scratch on Thursday October 05, 2023 @05:59PM
(#37784811)
The LLM is the output of the training system; the LLM doesn't do the reading, the trainer does. The LLM doesn't "contain" a copy of the book.
But some LLMs seem to be able to quote on demand from a wide range of literature; these models evidently do have some kind of memory, even if it's been distilled and blended and distilled again.
Re:OpenAI's justification for why training data is fair use,...
by ang_cire on Friday October 06, 2023 @04:33PM
(#37796014)
No, I am actually reading OpenAI's PDF linked here, where they say they make a copy of the online corpa to train on, right at the top of page 2:
> By analyzing large corpora (which necessarily involves first making copies of the data to be analyzed
Whether they retain that later is immaterial to whether copyright infringement occurred. Deleting a movie you illegally downloaded after you watch (train on) it doesn't make it legal.
Re:OpenAI's justification for why training data is fair use,...
by troupe on Saturday October 07, 2023 @03:22PM
(#37804682)
I agree with you. What I'm trying to differentiate is between the way you obtain a book and whether training an LLM on a book that you own the rights to read should be considered copyright infringement.
Re:OpenAI's justification for why training data is fair use,...
by ang_cire on Monday October 09, 2023 @02:20AM
(#37817460)
Unless the license you have for the book includes rights for commercial usage, it should be illegal to train a model that is being used for business, imo. In terms of individuals training models for their own personal use, I think that becomes much more tough to answer, but that's not really cropping up in the legal fights.