*Under certain conditions
My question is will it be before or after US elections?
The truth is that foundation model companies, while in the limelight now, are probably the smallest slice of the pie, with cloud providers and end user applications going to take the lion share of the profit, and GPU manufacturers in line next. Foundation model companies got hyped because every VC wanted to invest in the company that might monopolize AGI, but in reality we're going to have a landscape dominated by fine tuned open source models in a few years, with closed source models being used for certain niches but generally not worth the cost.
Regarding the monthly scale mentioned in article–we are way beyond that now.
A lot of really smart people worked on this and it was fun to watch unfold.
Google & Cohere give same pricing for non-tuned models vs tuned models.
OpenAIs fine tuning offering is non competitive.
I hope they will adjust their pricing
There's some exact words shenanigans here. Indeed may have reduced the number of tokens in the prompt by 80%, but they didn't reduce the cost by 80%: the prompt cost of inferring from a fine-tuned GPT-3.5-turbo ($3.00 / 1M tokens) is 6x the prompt cost of inferring from the base GPT-3.5-turbo ($0.50 / 1M tokens). If prompt tokens are cut to 20% of normal, then that implies the overall cost of the prompt tokens is 120% relative to their normal prompt: a cost increase! That's not even getting into the 4x cost of the completion tokens for a finetuned model.
Of course, Indeed likely has an enterprise contract reducing costs further.