Re:The Pile is a 825 GiB diverse, open source language model...
by arthurcolle on Thursday March 07, 2024 @02:51PM
(#39633803)
The training data distribution is the only thing that matters, not the actual content
[ Parent
| on HN ]
Re:The Pile is a 825 GiB diverse, open source language model...
by observationist on Thursday March 07, 2024 @04:11PM
(#39634626)
Unless you want something like style from a range of authors, knowledge of a fictional universe or storyline, or other domain specific data or style characteristics.
A blanket removal of copyrighted data would make a bot sterile, boring, unrelatable, and ignorant of culture and common memes. We have amazing AI technology. Let's lean into it and see where it goes.
Re:The Pile is a 825 GiB diverse, open source language model...
by __loam on Thursday March 07, 2024 @05:28PM
(#39635360)
By the violating the copyright hundreds of authors.
Re:The Pile is a 825 GiB diverse, open source language model...
by arthurcolle on Thursday March 07, 2024 @07:53PM
(#39636498)
I agree, hypothetically, if I were ever to have an opinion on the matter. Just playing to the audience and potential audiences if this ever gets read into evidence
;)
Haha... just kidding... unless.. ?