News for hackers. Stuff that matters.

A comment on The Pile is a 825 GiB diverse, open source language modelling data set. Parent comment

Re:The Pile is a 825 GiB diverse, open source language model... by clooper on Thursday March 07, 2024 @05:27PM (#39635352)
Have you heard of data unions?
[ Parent | on HN ]
Re:The Pile is a 825 GiB diverse, open source language model... by dougb5 on Thursday March 07, 2024 @06:03PM (#39635716)
I have not! What's your preferred background reading on this?
[ Parent | on HN ]
Re:The Pile is a 825 GiB diverse, open source language model... by clooper on Thursday March 07, 2024 @06:36PM (#39635965)
https://www.thedataunion.org/
[ Parent | on HN ]