News for hackers. Stuff that matters.
Re:The Pile is a 825 GiB diverse, open source language model... by jsheard on Thursday March 07, 2024 @01:34PM (#39632807)
This dataset includes "books3", which is a comprehensive dump of Bibliotik, a torrent tracker dedicated to pirated ebooks.

Throw a dart at a wall filled with every notable author/publisher ever and whoever you hit probably owns some of this data.

Apparently you can just do whatever as long as you say it's for AI research, go post Blu-ray rips online, it's fine provided you have a .ai domain :^)

Re:The Pile is a 825 GiB diverse, open source language model... by oldgradstudent on Thursday March 07, 2024 @02:13PM (#39633338)
It also contains an archive of opensubtitles, which is also not very open source.
Re:The Pile is a 825 GiB diverse, open source language model... by refulgentis on Thursday March 07, 2024 @02:48PM (#39633766)
The subtitles aren't open?

If you meant transcribing dialogue from a TV show is violating copyright, I'm not so sure, it's relatively common to quote dialogue for varied purposes, ex. TV critics

Definitely understand if you're saying the whole dialogue for a TV show is copyrighted, but I'm curious about the opensubtitles part, used to work in that area.

Re:The Pile is a 825 GiB diverse, open source language model... by layer8 on Thursday March 07, 2024 @02:57PM (#39633885)
Quoting excerpts is different from transcribing an entire work, which is unambiguously copyright infringement. (Otherwise you would find the “book” version of any and all TV shows on Amazon.) The subtitles in question are generally translations, which likewise fall under copyright, being a derived work.
Re:The Pile is a 825 GiB diverse, open source language model... by refulgentis on Thursday March 07, 2024 @03:05PM (#39633968)
Yeah, I was just curious about the opensubtitles site because I used to work in that field (subtitles) and wasn't sure if there were some new pirate sites that were monetizing subs.

n.b. not being argumentative, please don't read it that way, I apologize if it comes off that way:

Not every derived work is a copyright violation, that's why subs and dubs don't get kicked around, you can quote dialogue in an article, etc.[^1]

Answering if it applies to AI is playing out in court currently with ex. NYT v. OpenAI[^2] and Sarah Silverman et al v. OpenAI[^3] and v. Meta.[^4]

[^1] "Copyright doesn't protect against all use of the work or use of derivative works. There are a few exceptions that fall under what's commonly known as the fair use doctrine:" (https://www.legalzoom.com/articles/what-are-derivative-works...)

[^2] https://www.nytimes.com/2023/12/27/business/media/new-york-t...

[^3] https://www.theverge.com/2024/2/13/24072131/sarah-silverman-...

[^4] https://www.hollywoodreporter.com/business/business-news/sar...

Re:The Pile is a 825 GiB diverse, open source language model... by PavleMiha on Thursday March 07, 2024 @02:54PM (#39633856)
Quoting is very different from posting the full contents of something. I can quote a book but I can’t reproduce it in its entirety.
Re:The Pile is a 825 GiB diverse, open source language model... by refulgentis on Thursday March 07, 2024 @03:17PM (#39634106)
Right, you can't reproduce a book. W/r/t subs and dubs, fair use has applied historically.
Re:The Pile is a 825 GiB diverse, open source language model... by fsckboy on Thursday March 07, 2024 @01:55PM (#39633117)
> Throw a dart at a wall filled with every notable author/publisher ever

copyrights do expire, and any books older than Mickey Mouse are public domain, so it's not every notable author ever

Re:The Pile is a 825 GiB diverse, open source language model... by jsheard on Thursday March 07, 2024 @01:57PM (#39633155)
Technically true, narrow that down to merely "every notable living author and a subset of dead ones" then.

Bram Stokers bones will be relieved to hear that their work isn't being misappropriated.

Re:The Pile is a 825 GiB diverse, open source language model... by pk-protect-ai on Thursday March 07, 2024 @02:35PM (#39633603)
I wish it had included the books3, but it doesn't anymore. I wish it was possible to download that 36GB books3.tar in the wild these days. Herewith, I promise to use this dataset according to the "fair use" only...
Re:The Pile is a 825 GiB diverse, open source language model... by SekstiNi on Thursday March 07, 2024 @03:29PM (#39634225)
> I wish it was possible to download that 36GB books3.tar in the wild these days.

There... is a torrent.

Re:The Pile is a 825 GiB diverse, open source language model... by pk-protect-ai on Thursday March 07, 2024 @04:32PM (#39634822)
I know. But here where I am, using torrent means participate in distribution of the content and that is where I'll get huge bill for illegally sharing this file.
Re:The Pile is a 825 GiB diverse, open source language model... by MacsHeadroom on Thursday March 07, 2024 @11:12PM (#39637688)
Use a debrid provider or seedbox to download the torrent. They torrent it for you and then you direct download from them. Should cost $10 or less.
Re:The Pile is a 825 GiB diverse, open source language model... by gosub100 on Thursday March 07, 2024 @02:41PM (#39633685)
not the domain per se, but the high-powered law firms at your fingertips. Copyright law is much easier to enforce against working-class parents of 12-year-olds than SV elites.