News for hackers. Stuff that matters.

A comment on GPT-Neo – Building a GPT-3-sized model, open source and free. Parent comment

Re:GPT-Neo – Building a GPT-3-sized model, open source and free by tbenst on Monday January 18, 2021 @09:34AM (#25822143)
GPT-3 can’t play Go.
[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by Tenoke on Monday January 18, 2021 @11:59AM (#25823745)
It almost definitely can to some extent given that gpt2 could play chess [0].

0. https://slatestarcodex.com/2020/01/06/a-very-unlikely-chess-...

[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by nl on Monday January 18, 2021 @07:08PM (#25828339)
Retrained (or to be precise: fine-tuned) GPT2 can play chess after training on additional data.
[ Parent | on HN ]