News for hackers. Stuff that matters.
Re:OpenAI's justification for why training data is fair use,... by pbhjpbhj on Thursday October 05, 2023 @01:56PM (#37781766)
In order to present a book to a ML algorithm you need to copy it, either using a camera, or using other means (eg as a file). In USA that copying might be Fair Use, it's almost certainly not allowed in UK law AIUI.

Copying a webpage into a cache that allows presentation of the page to a user is only allowed because it is part of rendering the page to a user. Even if a computer only copies two words at a time from a source text, if it copies a substantial part overall then it still copied.

Honestly, I don't think slurping data to train ML models is allowed by copyright (but, I do, probably think it should be, as long as any significant reproductions are then prosecuted as infringements [also we should reduce copyright terms to ~7 years!]).

This is all my own opinion, unrelated to my employment.

Re:OpenAI's justification for why training data is fair use,... by Pet_Ant on Thursday October 05, 2023 @02:49PM (#37782496)
> In order to present a book to a ML algorithm you need to copy it, either using a camera, or using other means

Almost all modern books are available as ebooks for the Kindle or otherwise. You aren't doing anything to the content itself that could be a violation.

Re:OpenAI's justification for why training data is fair use,... by pbhjpbhj on Thursday October 05, 2023 @05:21PM (#37784452)
So, you copy the Kindle book from a server to your local host to feed into your training algo (ie other means). Or you stream it piecewise into a buffer, still copying.