Perhaps I’m missing your point, but isn’t that what they do with their API right now? You pay for text completions, and can fine-tune their model with your data.
But you can't run the code on your own machine.
Re:GPT in 60 Lines of NumPy
by mattnewton on Thursday February 09, 2023 @01:47PM
(#34729057)
Of course, if they leaked the model weight’s and a local inference binary for it they would lose the ability to charge for it. Clones with the weights would crop up all over the place.
> But you can't run the code on your own machine.
iirc GPT-3 itself alone is some 500TB in size. You need a really, really big machine to run LLMs, the first L means Large.
From various sources, the model itself is about 800 GB on disk.
Re:GPT in 60 Lines of NumPy
by hackernewds on Thursday February 09, 2023 @12:45PM
(#34727971)
They must have time traveled to today in the past and read your comment, since this is precisely their business model!
How large is the model on disk(s) once it is trained?