News for hackers. Stuff that matters.
Re:Customizing GPT-3 for Your Application by stavros on Tuesday December 14, 2021 @03:12PM (#29556868)
You mean half, not double. Davinci is $0.06 per 1k tokens but $0.03 for fine-tuning.
Re:Customizing GPT-3 for Your Application by inopinatus on Tuesday December 14, 2021 @03:13PM (#29556890)
No, I mean what I wrote. The usage price for fine-tuned models is double at $0.12 per 1k tokens.

The training price is half, but that’s likely gonna be lost in the noise of any significant bill. Unless you have to retrain often, in which case it’s just more overhead again to consider.

Re:Customizing GPT-3 for Your Application by stavros on Tuesday December 14, 2021 @03:30PM (#29557157)
Oh damn, I didn't notice that. Yeah, that changes the economics a lot.