News for hackers. Stuff that matters.
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by peyton on Tuesday October 31, 2023 @12:23AM (#38080268)
I dunno, at launch if you asked ChatGPT to make up a new Sir Mix-A-Lot song about big butts, it’d write very familiar lyrics more-or-less verbatim…
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by slyall on Tuesday October 31, 2023 @01:59AM (#38080835)
Lots of people would do the same.

I vaguely remember a short science fiction story where people got uploaded to the cloud. There were three options for your memories.

The expensive one you got to keep all your memories of Copyright music, video, books. The medium priced one it was replaced with public domain stuff. The cheap one it was all replaced with advertising.

Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by dasyatidprime on Tuesday October 31, 2023 @03:36AM (#38081348)
The results don't exactly match your description, but a cloud-run self in which multiple plans are available and in which the implications of copyright enforcement and advertising-supported options figure prominently was depicted in the short video “Welcome to Life: the singularity, ruined by lawyers” on Tom Scott's channel. https://www.youtube.com/watch?v=IFe9wiDfb0E
Re:RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by slyall on Tuesday October 31, 2023 @06:17AM (#38082554)
Thanks, Pretty sure thats probably the one I was remembering (and confusing the plot elements a bit).