News for hackers. Stuff that matters.
Re:Memorizing Transformers by tipsytoad on Friday May 20, 2022 @01:33PM (#31450388)
Could there be any merit training this on a common-sense dataset such as Cyc?

https://www.lesswrong.com/tag/cyc

Re:Memorizing Transformers by ipsum2 on Friday May 20, 2022 @05:18PM (#31452630)
Probably not, most common facts (sandcat is a type of feline) are already known by transformers. Maybe some obscure ones.