Re:The Pile is a 825 GiB diverse, open source language model...
by 7moritz7 on Thursday March 07, 2024 @04:48PM
(#39634959)
This very rarely happens, usually when trying hard to get it to regurgitate, and I don't think it has ever happened for anything longer than 2 paragraphs, or at most a short article. Certainly not something like a book or even the whole issue of a newspaper.
[ Parent
| on HN ]
Re:The Pile is a 825 GiB diverse, open source language model...
by fennecfoxy on Friday March 08, 2024 @06:23AM
(#39640043)
Yup, exactly. Passages from GoT appear because they're frequently referenced across the Internet, including the multiple wiki style sites for GoT fans, not necessarily because the LLM is regurgitating whole-book content it was trained on.