News for hackers. Stuff that matters.
Re:The Pile is a 825 GiB diverse, open source language model... by johndough on Thursday March 07, 2024 @02:33PM (#39633586)
I doubt that anyone is going to download and search through over 800 TB just to find a badly formatted copy of some book that could be found much quicker on different websites with better formatting. Authors are losing fractional cents here at most.
Re:The Pile is a 825 GiB diverse, open source language model... by gosub100 on Thursday March 07, 2024 @02:46PM (#39633744)
so just like Office Space? (paraphrasing) "We steal a fraction of a cent from each transaction, who do we hurt? Nobody. We just put the remainder into our account!"

Sorry that's not how damages are calculated in the US tort system.

Re:The Pile is a 825 GiB diverse, open source language model... by johndough on Thursday March 07, 2024 @02:50PM (#39633785)
I do not know how damages are calculated in the US tort system. What do they say about the books3 dataset?

I also think that the case is different here, since in your example, there is a specific amount of money being stolen, while in the books3 case, there is an unspecified amount of money not being made by the authors.

Re:The Pile is a 825 GiB diverse, open source language model... by SEGyges on Thursday March 07, 2024 @03:44PM (#39634378)
I am pretty sure if the authors were trying to license their works for this purpose we would just not use them at all; it is difficult to see under what circumstances they would stand to profit from this other than by suing people after the fact over it.
Re:The Pile is a 825 GiB diverse, open source language model... by doug_durham on Thursday March 07, 2024 @04:13PM (#39634651)
I think you could argue that authors could profit from their works being cited in an LLM response. It could drive sales of their works much like citations do on the web. The counter argument is that and LLM could give you the Clif Notes version of the work and thus taking away a portion of sales.
Re:The Pile is a 825 GiB diverse, open source language model... by SEGyges on Thursday March 07, 2024 @04:22PM (#39634732)
In a world where the options were to

1) pay the author,

2) implement guaranteed citation of the author any time the model gave an answer that was directly derivative, with an option to not do so if the summary was sufficiently vague, or

3) ignore the author's book completely as training data

we would all choose 3).

Re:The Pile is a 825 GiB diverse, open source language model... by __loam on Thursday March 07, 2024 @04:52PM (#39634997)
And the authors would probably be very happy that you did.
Re:The Pile is a 825 GiB diverse, open source language model... by __loam on Thursday March 07, 2024 @04:51PM (#39634985)
The penalty is up to $150k per violation.
Re:The Pile is a 825 GiB diverse, open source language model... by sp332 on Friday March 08, 2024 @11:04AM (#39642349)
For uploading, not downloading.