Re:It's Time to Stop Taking Sam Altman at His Word
by titanomachy on Saturday October 05, 2024 @12:01PM
(#41750792)
If we’re talking about inference costs alone (minimal new training) I think it would cover it. I started doing usage-based pricing through openrouter instead of paying monthly subscriptions, and my modest LLM use costs me about $3/month. Unless you think that the API rates are also priced below cost.
[ Parent
| on HN ]
Re:It's Time to Stop Taking Sam Altman at His Word
by mikeocool on Saturday October 05, 2024 @02:11PM
(#41751753)
According the New York Times [1], OpenAI told investors that they're costs are increasing as more people use their product, and they are planning to increase the cost of ChatGPT from $20 to $44 over the next five years. That certainly suggests that they're selling inference at a loss right now.
[1] https://www.nytimes.com/2024/09/27/technology/openai-chatgpt...
Re:It's Time to Stop Taking Sam Altman at His Word
by karmakaze on Sunday October 06, 2024 @09:47AM
(#41757160)
My bigger concern isn't the financial cost, it's that the amount represents a degree of energy expenditure. A flat rate might not be advisable and having usage-based pricing may limit energy waste. OTOH I don't know how much energy some of the other recurring things I consume monthly are either.
Maybe we can have a service that's an LLM with shared/cached responses as well as training on its own questions/answers for the easy stuff. Currently my usage is largely as a better search engine as google has gotten so much worse than it ever was, though I imagine I'll find custom things it's useful for as well.