News for hackers. Stuff that matters.
Re:OpenAI API by wildermuthn on Thursday June 11, 2020 @12:44PM (#23490671)
Precisely my point. If they could put a model as large as GPT-3 into production (at a reasonable price to the consumer), wouldn’t that be a 10x improvement?
Re:OpenAI API by krallistic on Thursday June 11, 2020 @12:50PM (#23490749)
GPT-3 isn't a 10X improvement. (At least from everything we know so far.)
Re:OpenAI API by wildermuthn on Thursday June 11, 2020 @01:06PM (#23490918)
If the OP is right that nobody is putting the largest models into production (which I think is in inaccurate statement), then GPT-3 in production would be a 10x (ok, 5x?) improvement over the small GPT-2s and BERTS in production? So 10x in practice, if the hypothesis is correct? Which like I said, I don’t believe to be the case.