Re:Books in .txt format for AI training purposes
by mdifrgechd on Sunday October 25, 2020 @11:50AM
(#24887170)
I can imagine building a model that is a derived work, but I don't see why all models trained on a corpus that contains some text can automatically be thought of as derived from that text in a creative sense. Models like GPT are using the text as a specific instance of the latent relationships that make up our language. The text is an example of english to learn from, it's not a creative work being extended.
Training a language model, I would argue, is equivalent (in terms of being derivative) to generating a list of the top ten words in a corpus of text. Not really a derived work.
Re:Books in .txt format for AI training purposes
by mdifrgechd on Sunday October 25, 2020 @11:56AM
(#24887227)
One possible counterpoint- sample based explanation techniques can tell what training data was most influential in a ML model's prediction, and this has been considered in language models[0]. So you could argue that if there are training examples within a corpus that are having an outsized influence on the model output, then maybe it is derivative. This would be pretty cool to look at - are some GPT or other language model outputs relying strongly on a few sources?
Re:Books in .txt format for AI training purposes
by lacker on Sunday October 25, 2020 @12:55PM
(#24887701)
It is probably not a derived work. To be a derived work it is not enough to simply use the original work in its construction; it must contain major copyrightable elements of the original work. The weights and parameters present in the model do not seem to fit that description; generally you can’t copyright a bunch of numbers. That said, I don’t think this has been confirmed by a major court case yet, and I wouldn’t be surprised if that happens at some point.
Re:Books in .txt format for AI training purposes
by fakedang on Monday October 26, 2020 @04:07AM
(#24893819)
But for a dynamically learning machine model, can you even copyright the numbers?
Re:Books in .txt format for AI training purposes
by mcguire on Sunday October 25, 2020 @01:30PM
(#24888059)
The question is, "Do the creators of bibliotik have proper licenses to aggregate those books into a dataset?" The dataset is certainly a derived work.
Edit: https://the-eye.eu/public/Books/humble_books_20180509/
Cue the "they're depriving me of my income" complaints from authors.
Re:Books in .txt format for AI training purposes
by nix23 on Sunday October 25, 2020 @01:39PM
(#24888182)
>The dataset is certainly a derived work
That was not the question.
Re:Books in .txt format for AI training purposes
by mcguire on Sunday October 25, 2020 @01:41PM
(#24888195)
"Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned."
Re:Books in .txt format for AI training purposes
by nix23 on Sunday October 25, 2020 @01:53PM
(#24888305)
And you where thinking, lets rephrase that question because it's not already boring and obvious enough?
Re:Books in .txt format for AI training purposes
by Spooky23 on Sunday October 25, 2020 @11:43AM
(#24887115)
If AI has human like rights to read and learn and create derived works, what other rights does it have?
Perhaps we should figure that before we start a dystopian nightmare of written material.
Re:Books in .txt format for AI training purposes
by ahoka on Sunday October 25, 2020 @11:14AM
(#24886872)
Of course it is a derived work.
Re:Books in .txt format for AI training purposes
by kerng on Sunday October 25, 2020 @12:17PM
(#24887369)
Maybe not so obvious. If you read a book, are you a derivative work?
Re:Books in .txt format for AI training purposes
by nix23 on Sunday October 25, 2020 @12:59PM
(#24887742)
Soo reading the Kama Sutra leads to derivative "work" too :)
Re:Books in .txt format for AI training purposes
by blackoil on Sunday October 25, 2020 @02:16PM
(#24888527)
I read a Java book and created programs using knowledge given in the book. Is my program a derived work?
Re:Books in .txt format for AI training purposes
by ahoka on Sunday October 25, 2020 @04:22PM
(#24889574)
A book on Java was written to teach you Java, so it would be foolish to claim any copyright on your program.
Or is the trained model a derived work of those books?