Re:OpenAI employees did not want to go work for Microsoft
by lumost on Thursday December 07, 2023 @06:43PM
(#38563375)
I’d be curious if $20/mo is or is not enough to cover their costs. It’s opaque what their inference setup is, or what the final economics of LLMs will be. With 30-100 Billion param models becoming available which are in spitting distance of gpt-4, and dedicated ASIC implementations… openAI might be charging too much.
Re:OpenAI employees did not want to go work for Microsoft
by scarface_74 on Thursday December 07, 2023 @07:52PM
(#38563999)
Are you taking into account they are also paying far below market costs for compute or even what a large customer could negotiate?
Re:OpenAI employees did not want to go work for Microsoft
by Grimblewald on Thursday December 07, 2023 @11:38PM
(#38565518)
So because their costs are lower than that of competitors, customers should pay more? Ok.
Re:OpenAI employees did not want to go work for Microsoft
by scarface_74 on Friday December 08, 2023 @09:02AM
(#38569130)
There costs are lower…for now. Do you think Microsoft is going to subsidize them forever?
Re:OpenAI employees did not want to go work for Microsoft
by lumost on Friday December 08, 2023 @10:29AM
(#38570176)
GPUs will be cheaper later. GPUs have still been tracking Moore's law, enterprise GPUs went from a niche product to being the hottest enterprise hardware overnight. Margins on H200's are massive from what I understand. I would bet that we'll see massive competition in the hardware space from AMD, NVDA, MSFT, AMZN, and GOOG + startups.
We're likely to see an 8-16x reduction in hardware costs over the next decade. That's about enough to shrink the current GPT-4 inference endpoints to a laptop/desktop sized hardware footprint.
Re:OpenAI employees did not want to go work for Microsoft
by PeterStuer on Friday December 08, 2023 @11:28AM
(#38570822)
Can you provide a source for this?
Since it is MS providing the compute for equity, they would not have an incentive to discount.
Re:OpenAI employees did not want to go work for Microsoft
by a_bonobo on Thursday December 07, 2023 @06:28PM
(#38563235)
It is implied in OP's reply too, right? No word about 'hey we're giving powerful tech to a hyper-monopolist', it's only about your friends and the money
You think the employees at “Open” AI care about anything more than their large paychecks no matter what they say?