News for hackers. Stuff that matters.

A comment on OpenAI API. Parent comment

Re:OpenAI API by m_ke on Thursday June 11, 2020 @12:03PM (#23490250)
Nobody is putting these huge models in production, even the smaller transformer models are still too expensive to run for most use cases.

With the way the field is moving, GPT-3 will be old news in a month, when more advances are made and open sourced.

[ Parent | on HN ]
Re:OpenAI API by fongitosous on Thursday June 11, 2020 @01:33PM (#23491201)
i don't understand. if they run it for you and you apply transfer learning and fine tuning on your specific use case that would reduce drastically the costs hence why their offer make sense
[ Parent | on HN ]
Re:OpenAI API by wildermuthn on Thursday June 11, 2020 @12:44PM (#23490671)
Precisely my point. If they could put a model as large as GPT-3 into production (at a reasonable price to the consumer), wouldn’t that be a 10x improvement?
[ Parent | on HN ]
Re:OpenAI API by krallistic on Thursday June 11, 2020 @12:50PM (#23490749)
GPT-3 isn't a 10X improvement. (At least from everything we know so far.)
[ Parent | on HN ]
Re:OpenAI API by wildermuthn on Thursday June 11, 2020 @01:06PM (#23490918)
If the OP is right that nobody is putting the largest models into production (which I think is in inaccurate statement), then GPT-3 in production would be a 10x (ok, 5x?) improvement over the small GPT-2s and BERTS in production? So 10x in practice, if the hypothesis is correct? Which like I said, I don’t believe to be the case.
[ Parent | on HN ]