News for hackers. Stuff that matters.
Re:GPT-2: 6-Month Follow-Up by p1esk on Tuesday August 20, 2019 @04:18PM (#20751613)
It would take forever (or $$$) to train even 117M model from scratch.
Re:GPT-2: 6-Month Follow-Up by JonathanFly on Tuesday August 20, 2019 @05:02PM (#20752107)
I read that meaning you can start with the actual pre-trained GPT-2 models but I never got an answer when I specifically asked if that was the case.