News for hackers. Stuff that matters.
Re:OpenAI Completes Deal That Values Company at $157B by JamesBarney on Wednesday October 02, 2024 @05:48PM (#41725283)
> I wouldn't even be surprised if they were losing money on paying ChatGPT users on inference compute alone

I'd be surprised it that was the case. How many tokens is the average user going through? I'd be surprised if the avg user even hit a 1m tokens much less 20m.

Re:OpenAI Completes Deal That Values Company at $157B by MacsHeadroom on Wednesday October 02, 2024 @07:07PM (#41725744)
o1 is about $2-$4 per message over the API. I'm probably costing OpenAI less than 24hrs after my subscription renewal each month.

Voice mode is around $0.25 per minute via API. I don't use that much, but 3 minutes ago per day would already exceed the cost of a ChatGPT Plus subscription by quite a bit.

Re:OpenAI Completes Deal That Values Company at $157B by vintagedave on Thursday October 03, 2024 @12:16PM (#41732086)
> o1 is about $2-$4 per message over the API

I’m not sure I understand this, sorry. I see GPT-4o at $3.75 per million input tokens and $10 per million output tokens, on OpenAI’s pricing page.

That’s expensive and I can’t see how they can run Copilot on the standard API pricing. But, it makes a message (one interaction?) lower cost than $4 to me.

How many tokens are in a typical message for you?

Re:OpenAI Completes Deal That Values Company at $157B by lxgr on Wednesday October 02, 2024 @06:09PM (#41725414)
With o1? A lot.

Even for regular old 4o: You’re comparing to their API rates here, which might or might not cover their compute cost.