News for hackers. Stuff that matters.
Re:Are we in an AI Overhang? by aveni on Monday July 27, 2020 @11:32AM (#23966059)
GPT-3 is not that expensive. Estimating from the paper, to train the model, the GPU hardware costs were a few million dollars, and the electricity costs were probably under 100k. This is totally feasible for many companies today, especially if the hardware is a fixed cost and can be reused for training multiple models.

And as mentioned elsewhere, inference for a trained model is much, much cheaper.

There are no comments on this comment yet.