News for hackers. Stuff that matters.

A comment on The Pile is a 825 GiB diverse, open source language modelling data set. Parent comment

Re:The Pile is a 825 GiB diverse, open source language model... by chasd00 on Thursday March 07, 2024 @03:28PM (#39634214)
if the pile contains the code to go from step 1 to step 2 and then to 3 then couldn't you just remove the parts you don't want from the raw dataset and re-run the code?
[ Parent | on HN ]

There are no comments on this comment yet.