News for hackers. Stuff that matters.
Re:OpenAI employees did not want to go work for Microsoft by scarface_74 on Thursday December 07, 2023 @06:17PM (#38563124)
Open AI doesn’t have any meaningful “products” they have good technology and they charge $20 a month for a subscription to a technology demo that doesn’t come close to covering their costs.

You think the employees at “Open” AI care about anything more than their large paychecks no matter what they say?

Re:OpenAI employees did not want to go work for Microsoft by lumost on Thursday December 07, 2023 @06:43PM (#38563375)
I’d be curious if $20/mo is or is not enough to cover their costs. It’s opaque what their inference setup is, or what the final economics of LLMs will be. With 30-100 Billion param models becoming available which are in spitting distance of gpt-4, and dedicated ASIC implementations… openAI might be charging too much.
Re:OpenAI employees did not want to go work for Microsoft by scarface_74 on Thursday December 07, 2023 @07:52PM (#38563999)
Are you taking into account they are also paying far below market costs for compute or even what a large customer could negotiate?
Re:OpenAI employees did not want to go work for Microsoft by Grimblewald on Thursday December 07, 2023 @11:38PM (#38565518)
So because their costs are lower than that of competitors, customers should pay more? Ok.
Re:OpenAI employees did not want to go work for Microsoft by scarface_74 on Friday December 08, 2023 @09:02AM (#38569130)
There costs are lower…for now. Do you think Microsoft is going to subsidize them forever?
Re:OpenAI employees did not want to go work for Microsoft by lumost on Friday December 08, 2023 @10:29AM (#38570176)
GPUs will be cheaper later. GPUs have still been tracking Moore's law, enterprise GPUs went from a niche product to being the hottest enterprise hardware overnight. Margins on H200's are massive from what I understand. I would bet that we'll see massive competition in the hardware space from AMD, NVDA, MSFT, AMZN, and GOOG + startups.

We're likely to see an 8-16x reduction in hardware costs over the next decade. That's about enough to shrink the current GPT-4 inference endpoints to a laptop/desktop sized hardware footprint.

Re:OpenAI employees did not want to go work for Microsoft by PeterStuer on Friday December 08, 2023 @11:28AM (#38570822)
Can you provide a source for this?

Since it is MS providing the compute for equity, they would not have an incentive to discount.

Re:OpenAI employees did not want to go work for Microsoft by a_bonobo on Thursday December 07, 2023 @06:28PM (#38563235)
It is implied in OP's reply too, right? No word about 'hey we're giving powerful tech to a hyper-monopolist', it's only about your friends and the money
Re:OpenAI employees did not want to go work for Microsoft by zombiwoof on Friday December 08, 2023 @01:42AM (#38566086)
* this *

notice how the one OpenAI employee posted he'd "consider it" if the comp was right. Ie, it's about the money.

Re:OpenAI employees did not want to go work for Microsoft by andrewjf on Friday December 08, 2023 @10:24AM (#38570103)
Yep. Someone is going to get the money, I’d like it to be the employees.