News for hackers. Stuff that matters.
Re:GPT-4 API General Availability by chrisshroba on Thursday July 06, 2023 @08:20PM (#36625259)
Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.
Re:GPT-4 API General Availability by jiggawatts on Thursday July 06, 2023 @08:28PM (#36625323)
They're giving people access to GPT-4 via Bing for free, but apparently can't accommodate paying API users!?

That makes no sense.

What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

Re:GPT-4 API General Availability by 90d on Thursday July 06, 2023 @08:52PM (#36625536)
"Free". The worst four-letter F word in America.
Re:GPT-4 API General Availability by cptaj on Thursday July 06, 2023 @08:52PM (#36625541)
Microsoft is giving that for free but I assume they're paying OpenAI for it.

And having such a big anchor tenant, its reasonable that you would prioritize them if GPUs are in short supply.

Re:GPT-4 API General Availability by selcuka on Thursday July 06, 2023 @09:09PM (#36625679)
> Microsoft is giving that for free but I assume they're paying OpenAI for it.

Yeah, but Microsoft already gets 75% of the profits OpenAI makes, it's not the same price for them as the rest of us.

Re:GPT-4 API General Availability by ec109685 on Thursday July 06, 2023 @09:30PM (#36625830)
It’s the exactly the same. If they could make 75 cents selling the compute to someone else for $1 versus not making it providing the Bing chat service, that is 75 cents they lose.
Re:GPT-4 API General Availability by selcuka on Friday July 07, 2023 @01:18AM (#36627488)
Why do you assume that the same amount of computing power would be used by someone else? There are only so many customers. You can't magically start selling more compute if you stop using it yourself.
Re:GPT-4 API General Availability by ec109685 on Sunday July 09, 2023 @04:07PM (#36658351)
At scale, GPU's are capacity constrained right now, so if Microsoft stopped using them, their capacity would be absorbed by others.
Re:GPT-4 API General Availability by itissid on Thursday July 06, 2023 @11:48PM (#36626857)
10 billion$
Re:GPT-4 API General Availability by flangola7 on Thursday July 06, 2023 @09:20PM (#36625768)
Bing GPT-4 is a much smaller and less capable model than regular GPT-4.
Re:GPT-4 API General Availability by jerrygenser on Thursday July 06, 2023 @08:26PM (#36625301)
I think GPUs are in short supply and Nvidia can't make enough to keep up with demand.
Re:GPT-4 API General Availability by ben_w on Friday July 07, 2023 @05:54AM (#36629443)
To a first approximation, the increased share price of NVIDIA is because AI developers including OpenAI bought as many as NVIDIA can make.