News for hackers. Stuff that matters.
Re:The Pile is a 825 GiB diverse, open source language model... by feoren on Thursday March 07, 2024 @05:54PM (#39635638)
> The size of the final model is orders of magnitude smaller than the size of the training data.

Good to know I can avoid copyright on a book just by zipping it up!

Re:The Pile is a 825 GiB diverse, open source language model... by Workaccount2 on Friday March 08, 2024 @09:36AM (#39641409)
No, you can't. But you can by reading the book, writing down the general gist of it (even including some passages), and then storing that.

LLM's are not compressing petabytes of information down to a few gigabytes.