News for hackers. Stuff that matters.
Re:This word does not exist by thomasahle on Tuesday October 26, 2021 @07:35PM (#29007801)
This is just GPT-2 btw.
Re:This word does not exist by gwern on Tuesday October 26, 2021 @08:03PM (#29008029)
This isn't even 'GPT-2'! Since that usually refers to GPT-2-1.5b. It's GPT-2-117M... distilled, so an even smaller version of the smallest GPT-2. Amazing it works so well anyway.