News for hackers. Stuff that matters.
Re:OpenAI API by canjobear on Friday June 12, 2020 @02:15AM (#23496537)
The pretraining approach was used in vision for years before it was successful in NLP.
Re:OpenAI API by julien_c on Friday June 12, 2020 @03:09AM (#23496820)
Not really on unsupervised/self-supervised data though, right?

(nor on the same scale of corpora, as far as I can tell)