Re:The Pile is a 825 GiB diverse, open source language model...
by fennecfoxy on Friday March 08, 2024 @06:23AM
(#39640043)
Yup, exactly. Passages from GoT appear because they're frequently referenced across the Internet, including the multiple wiki style sites for GoT fans, not necessarily because the LLM is regurgitating whole-book content it was trained on.
[ Parent
| on HN ]
There are no comments on this comment yet.