News for hackers. Stuff that matters.
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by valine on Monday October 30, 2023 @11:15PM (#38079831)
People say this like it’s a fact. Until the courts decide otherwise or your AI model is regurgitating copyrighted data verbatim, generative AI is probably not violating copyright.
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by peyton on Tuesday October 31, 2023 @12:23AM (#38080268)
I dunno, at launch if you asked ChatGPT to make up a new Sir Mix-A-Lot song about big butts, it’d write very familiar lyrics more-or-less verbatim…
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by slyall on Tuesday October 31, 2023 @01:59AM (#38080835)
Lots of people would do the same.

I vaguely remember a short science fiction story where people got uploaded to the cloud. There were three options for your memories.

The expensive one you got to keep all your memories of Copyright music, video, books. The medium priced one it was replaced with public domain stuff. The cheap one it was all replaced with advertising.

Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by dasyatidprime on Tuesday October 31, 2023 @03:36AM (#38081348)
The results don't exactly match your description, but a cloud-run self in which multiple plans are available and in which the implications of copyright enforcement and advertising-supported options figure prominently was depicted in the short video “Welcome to Life: the singularity, ruined by lawyers” on Tom Scott's channel. https://www.youtube.com/watch?v=IFe9wiDfb0E
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by slyall on Tuesday October 31, 2023 @06:17AM (#38082554)
Thanks, Pretty sure thats probably the one I was remembering (and confusing the plot elements a bit).
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by munchler on Tuesday October 31, 2023 @01:03AM (#38080552)
Training a model with this data might be legal, but distributing the data without a license probably isn't.
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by sillysaurusx on Tuesday October 31, 2023 @03:42AM (#38081378)
The courts are in the process of deciding otherwise. https://news.ycombinator.com/item?id=37962244

Hopefully they won’t, but it’s not looking good.

The annoying part is that if they do decide it’s infringement, then open source AI models won’t be allowed to know anything about copyrighted works. It’ll be a big blind spot.

Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by ImprobableTruth on Tuesday October 31, 2023 @06:22AM (#38082589)
Why would this only apply to open source models? Or are you assuming that a company like OAI could license all the material?
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by sillysaurusx on Tuesday October 31, 2023 @07:44AM (#38083294)
Bingo. Big companies won’t be impacted.