News for hackers. Stuff that matters.
Re:Yann LeCun on GPT-3 by lavoiems on Tuesday October 27, 2020 @11:37AM (#24908437)
GPT-3 is a generative model, isn't it? Can you explain how you converted GPT-3 to a classification model?
Re:Yann LeCun on GPT-3 by picodguyo on Tuesday October 27, 2020 @12:12PM (#24908827)
There are a couple of ways to do it. You can give it a prompt that shows examples of the classification and it mimics what it thinks is the correct behavior when you feed it new unclassified input. They also have a search endpoint that lets you do classification by giving it an input along with labels as the searchable documents and using the resulting semantic relevance scores.
Re:Yann LeCun on GPT-3 by 0-_-0 on Tuesday October 27, 2020 @11:49AM (#24908569)
You can add new "heads" to GPT networks and train those heads to use GPT for new applications.
Re:Yann LeCun on GPT-3 by mkolodny on Tuesday October 27, 2020 @01:56PM (#24910000)
Not with GPT-3. I believe only Microsoft is allowed to do that.