News for hackers. Stuff that matters.
Re:GPT in 60 Lines of NumPy by MuffinFlavored on Thursday February 09, 2023 @12:16PM (#34727371)
Will one business model be for OpenAI to "license" out access to their trained model?

How large is the model on disk(s) once it is trained?

Re:GPT in 60 Lines of NumPy by theptip on Thursday February 09, 2023 @12:25PM (#34727547)
Perhaps I’m missing your point, but isn’t that what they do with their API right now? You pay for text completions, and can fine-tune their model with your data.
Re:GPT in 60 Lines of NumPy by veqq on Thursday February 09, 2023 @01:39PM (#34728925)
But you can't run the code on your own machine.
Re:GPT in 60 Lines of NumPy by mattnewton on Thursday February 09, 2023 @01:47PM (#34729057)
Of course, if they leaked the model weight’s and a local inference binary for it they would lose the ability to charge for it. Clones with the weights would crop up all over the place.
Re:GPT in 60 Lines of NumPy by est on Saturday February 11, 2023 @12:57AM (#34749953)
> But you can't run the code on your own machine.

iirc GPT-3 itself alone is some 500TB in size. You need a really, really big machine to run LLMs, the first L means Large.

Re:GPT in 60 Lines of NumPy by shagie on Thursday February 09, 2023 @12:18PM (#34727414)
From various sources, the model itself is about 800 GB on disk.
Re:GPT in 60 Lines of NumPy by hackernewds on Thursday February 09, 2023 @12:45PM (#34727971)
They must have time traveled to today in the past and read your comment, since this is precisely their business model!