Re:Are we in an AI Overhang?
by aveni on Monday July 27, 2020 @11:32AM
(#23966059)
GPT-3 is not that expensive. Estimating from the paper, to train the model, the GPU hardware costs were a few million dollars, and the electricity costs were probably under 100k. This is totally feasible for many companies today, especially if the hardware is a fixed cost and can be reused for training multiple models.
And as mentioned elsewhere, inference for a trained model is much, much cheaper.
And as mentioned elsewhere, inference for a trained model is much, much cheaper.