News for hackers. Stuff that matters.
Re:GPT in 60 Lines of NumPy by theptip on Thursday February 09, 2023 @12:25PM (#34727547)
Perhaps I’m missing your point, but isn’t that what they do with their API right now? You pay for text completions, and can fine-tune their model with your data.
Re:GPT in 60 Lines of NumPy by veqq on Thursday February 09, 2023 @01:39PM (#34728925)
But you can't run the code on your own machine.
Re:GPT in 60 Lines of NumPy by mattnewton on Thursday February 09, 2023 @01:47PM (#34729057)
Of course, if they leaked the model weight’s and a local inference binary for it they would lose the ability to charge for it. Clones with the weights would crop up all over the place.
Re:GPT in 60 Lines of NumPy by est on Saturday February 11, 2023 @12:57AM (#34749953)
> But you can't run the code on your own machine.

iirc GPT-3 itself alone is some 500TB in size. You need a really, really big machine to run LLMs, the first L means Large.