News for hackers. Stuff that matters.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:18AM (#42865898)
No; those costs were their moat.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by whatshisface on Wednesday January 29, 2025 @10:21AM (#42865947)
I wish more people had understood that spending a lot of money processing publicly available commodities with techniques available in the published literature is the business model of a steel mill.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @10:37AM (#42866193)
> is the business model of a steel mill

It’s the business of commodities. The magic is in tiny incremental improvements and distribution. DeepSeek forces us to question if AI—possibly intelligence—is a commodity.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by camdenreslink on Wednesday January 29, 2025 @12:11PM (#42867878)
I’m not sure I’d call what LLMs do intelligence. Not yet anyway…
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @01:35PM (#42869180)
> not sure I’d call what LLMs do intelligence

No, but it's good enough to replace some office jobs. Which forces us to ask, to what degree is intelligence--unique intelligence--required for useful production? (We can ask the same about physical strength.)

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by FridgeSeal on Wednesday January 29, 2025 @02:38PM (#42870066)
I find it interesting that so much discussion about “LLM’s can do some of our work” is centred around “are they intelligence” and not what I see as the precursor question of “are we doing a lot of bullshit work?”

My partner is in law, along with several friends and the amount of completely _useless_ work and ceremony they’re forced to do is insane. It’s a literal waste of their talent and time. We could probably net most of the claimed AI gains by taking a serious look at pointless workloads and come out ahead due to not needing the energy and capital expenditure.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by sebzim4500 on Wednesday January 29, 2025 @11:02AM (#42866638)
Surely that would be amazing for NVDA? If the only 'hard' part of making AI is making/buying/smuggling the hardware then nvidia should expect to capture most of the value.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @11:14AM (#42866833)
> that would be amazing for NVDA?

It’s good for Nvidia. It’s not as good as it was before. (Assuming DeepSeek’s claims are replicable.)

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @11:04AM (#42866667)
DeepSeek revealed it's not as hard as previously thought; a much smaller number of less sophisticated chips was sufficient.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JoshTko on Wednesday January 29, 2025 @12:21PM (#42868006)
No. Before Deepseek R1, Nvidia was charging $100 for a $20 shovel in the gold rush. Now, every Fortune 100 can build an O1-level model with currently existing (and soon to be online) infra. Healthy demand for H100 and Blackwell will remain, but paying $100 for a $20 shovel is unlikely.

Nvidia will definitely stay profitable for now though, as long as Deepseek’s breakthroughs are not further improved upon. But if others find additional compression gains, Nvidia won’t recapture its old premium. Its stock hinged on 80% margins and 75% annual growth, Deepseek broke that premise.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by wongarsu on Wednesday January 29, 2025 @01:06PM (#42868724)
There still isn't a serious alternative for chips for AI training. Until competition catches up or models become so efficient they can be trained on gaming cards Nvidia will still be able to command the same margins.

Growth might take a short-term dip, but may well be picked up by induced demand. Being able to train your own models "cheaply" will cause a lot more companies and departments want to train their own models on their own data, and cause them to retrain more frequently.

The time of being able to sell H100 clusters for inference might be coming to an end though.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by throwaway48476 on Wednesday January 29, 2025 @12:23PM (#42868037)
NVDA is too invested in training and underinvested in edge inference.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by scotty79 on Wednesday January 29, 2025 @11:27AM (#42867075)
Maybe they even suppressed algorithmic improvements in their company to preserve moat. Something akin to Kodak suppressing internal research on digital cameras because they were world leading company that produced photo film.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by cjbgkagh on Wednesday January 29, 2025 @10:22AM (#42865977)
But have you heard of Jevons Paradon…… /s

OMG, it seems tech has been invaded by baaing crypto bros

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:20AM (#42865940)
You don't need a moat when you're in first place.

Their moat is >1B people are already using ChatGPT monthly.

They aren't going to switch unless something is substantially better.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by like_any_other on Wednesday January 29, 2025 @10:30AM (#42866076)
> Their moat is >1B people are already using ChatGPT monthly.

Unlike a social network, network effects won't help them - their users don't care how many other users they have, only about the AI output quality.

> They aren't going to switch unless something is substantially better.

Or approximately as good but cheaper.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:34AM (#42866150)
> Or approximately as good but cheaper.

You're fooling yourself if you think OpenAI is going to pass up implementing the same strategies to get a ~27x cheaper model.

> Unlike a social network, network effects won't help them - their users don't care how many other users they have, only about the AI output quality.

Google Search doesn't have a network effect. Everyone on HN has been saying Google Search is complete garbage for a decade. It still has the same market share (roughly) as it did a decade ago.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by like_any_other on Wednesday January 29, 2025 @10:37AM (#42866204)
> You're fooling yourself if you think OpenAI is going to pass up implementing the same strategies to get a ~27x cheaper model.

But that would mean a 27x lower valuation.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @10:42AM (#42866281)
> that would mean a 27x lower valuation

Not directly. The 27x is about costs. What it means is some order of magnitude of more competition. That reduces natural market share, price leverage and thus future profits.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:41AM (#42866275)
> But that would mean a 27x lower valuation.

No.

Valuations are based on future profits. Not future revenues.

You can theoretically lower your costs by 27x and end up with 2x more future profits - if you're actually 45x cheaper (which DeepSeek's method claims to be).

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by like_any_other on Wednesday January 29, 2025 @10:55AM (#42866516)
You mean charge a 27x lower price, but have 45x lower costs, so your profit margin has doubled?

Your relative margin may have doubled, but your absolute profit-per-item hasn't. Say you had a 10% margin before, at a $100 price and $90 cost, for a $10 profit-per-item. Reduce price 27x and cost 45x, so $3.7 price, $2 cost, and $1.7 profit-per-item. 6x less profit - not as bad as 27x, but not good if you're OpenAI.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:59AM (#42866582)
> Your relative margin may have doubled, but your absolute profit-per-item hasn't.

ChatGPT doesn't have any profits right now.

We have no idea what investors are expecting future profits to be.

> Say you had a 10% margin before, at a $100 price and $90 cost, for a $10 profit-per-item. Reduce price 27x and cost 45x, so $3.7 price, $2 cost, and $1.7 profit-per-item. 6x less profit - not as bad as 27x, but not good if you're OpenAI.

Now do the same thing but assume you have 10x more subscribers because the prices are ~27x lower.

You end up with almost 2x more total profit.

Just take ChatGPT's ~$200 subscription. Hardly anyone is going to pay ~$200 a month. Reduce that by 27x - and you're at $7.5 per month. Maybe 10% of people on the planet will pay that.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @11:01AM (#42866618)
> Now do the same thing but assume you have 10x more subscribers because the prices are ~27x lower.

You're in various spots of this thread pushing the idea that their 1B MAUs make them unassailable. How are they gonna get to 10B in a world with less than that total people?

> Just take ChatGPT's ~$200 subscription. Hardly anyone is going to pay ~$200 a month. Reduce that by 27x - and you're at $7.5 per month. Maybe 10% of people on the planet will pay that.

They can't even make money at the $200 price point, though. https://x.com/sama/status/1876104315296968813

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by hadlock on Thursday January 30, 2025 @05:15AM (#42876486)
if ChatGPT starts selling ads on chat results that will probably improve revenue. I've seen social media ads recently for things I've only typed into ChatGPT so that leads me to believe they're already monetizing it to advertising platforms.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:48AM (#42866407)
> Valuations are based on future profits.

Which are estimated, in significant part, by the chance of a competitor arising.

If the barriers of entry are much lower than originally thought, the potential profit margin plummets.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by rurp on Wednesday January 29, 2025 @10:54AM (#42866490)
Google spends immense amounts of resources every year to ensure that their search is almost always the default option. Defaults are extremely powerful in consumer tech.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by gtirloni on Wednesday January 29, 2025 @10:43AM (#42866302)
Other search engines don't have a gigantic advertising budget or a dominant browser pounding on users' heads to use them.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by digitalPhonix on Wednesday January 29, 2025 @12:44PM (#42868383)
> Google Search doesn't have a network effect. Everyone on HN has been saying Google Search is complete garbage for a decade. It still has the same market share (roughly) as it did a decade ago.

It absolutely does. People use Google for search -> Websites optimise for Google -> People get “better” results when searching with Google.

The fact that it’s market share is sticky and not responding quickly to change in quality is sort of indicative of the network effect.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by jasonjmcghee on Wednesday January 29, 2025 @10:45AM (#42866362)
1 billion MAU? What's the source on that? Very difficult to believe.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @11:14AM (#42866836)
It probably counts pretty much anyone on a newer iPhone/Mac (https://support.apple.com/en-au/guide/iphone/iph00fd3c8c2/io...) and Windows/Bing. Plus all the smaller integrations out there. All of which can be migrated to a new LLM vendor... pretty quickly.

I wonder what the direct user counts are.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by kgwgk on Wednesday January 29, 2025 @10:44AM (#42866342)
https://archive.is/c6cn9

« The thing I noticed right away when Claude came out is how little lock-in ChatGPT had established. This was very different to my experience when I first ran a search on Google, sometime in the year 2000. After the first time I used Google, I literally never used another search engine again; it was just light years ahead of its competitors in terms of the quality of its results, and the clarity of its presentation. This week I added a third chatbot to the mix: DeepSeek »

Follow up: https://x.com/TheStalwart/status/1884606421225848889

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by mohsen1 on Wednesday January 29, 2025 @11:24AM (#42867022)
My guess is that OS vendors are the real winners in the long run. If Siri/Goolge can access my stuff and core of LLMs is this replicable then I don't see anyone downloading any apps for their typical AI usage. Specially that users have to go out of their way to allow a 3rd party to access all their data.

This is why OpenAI is so deep in the product development phase right now. They have to become the OS to be successful but I don't see that happening

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by Sateeshm on Wednesday January 29, 2025 @10:59AM (#42866583)
There is no network effect (amazon, instagram, etc.) not an enterprise vendor lock-in (Microsoft Office/AD, Apple Appstore, etc.) In fact, it's quite the opposite, the way these companies deliver ouput is damn near identical. Switching between them is pretty painless.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:21AM (#42865954)
> You don't need a moat when you're in first place.

Tell that to Friendster/MySpace and Facebook.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:23AM (#42865987)
Cute - but MySpace didn't have >1B users, it didn't even have 10M when Facebook launched.

Try again.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:26AM (#42866026)
Nothing had a billion users; the Internet didn't at the time.

MySpace and Friendster both spent significant time as the #1 social sites. Facebook unseated them rapidly. The same is possible for OpenAI.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:36AM (#42866177)
There were ~900M internet users in 2004. Only ~1M of them were on MySpace.

That's 1 in 900.

There's 5.5B internet users in 2024. ~1B of them used ChatGPT monthly.

That's 1 in 5.

Do you see the difference yet?

It's literally orders of magnitude.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:38AM (#42866224)
MySpace and Friendster both claimed ~115M peak users.

> It's literally orders of magnitude.

Sure, and the speed at which ChatGPT went from zero to a billion is precisely why they need a moat... because otherwise the next one can do it to them.

Your argument is like a railroad company in 1905 scoffing at the idea that airliners will be a thing.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:44AM (#42866326)
Peek users is not the amount of users they had when Facebook started.

Facebook probably would've never became a thing if MySpace already had ~115M users when it started.

MySpace had ~1M.

That's why DeepSeek (or anyone else) is going to have an incredibly difficult time convincing ~1B to switch from ChatGPT to their tool instead.

Can it happen? For sure.

Will it happen? Less likely.

If anyone unseats ChatGPT - it's much more likely to be a usual suspect like Google, Apple, or Microsoft - then some obscure company no one has ever heard of.

Of course, anything is possible.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by cjbgkagh on Wednesday January 29, 2025 @10:25AM (#42866013)
It had more than Facebook when Facebook launched so I’m not sure what your point is
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by shmeeed on Wednesday January 29, 2025 @02:43PM (#42870115)
Dude, if you seriously believe OpenAI has 1B active users, you should go touch grass. Actual estimates are 100-200 million, about a magnitude lower.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @10:41AM (#42866265)
> You don't need a moat when you're in first place

There are different moats [1]. You’re describing incumbency, an intangible moat. It’s nice, but it’s fickle. Particularly with something with low switching costs.

OpenAI could argue, before, that it had a natural monopoly. More people use OpenAI so it gets more revenue and more data which lets it raise more capital to train these expensive models. That may not be true, which means it only has that first, shallow moat. It’s Nike. Not Google.

[1] https://en.m.wikipedia.org/wiki/Economic_moat

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by onlyrealcuzzo on Wednesday January 29, 2025 @10:42AM (#42866289)
> There are different moats [1]. You’re describing incumbency, an intangible moat. It’s nice, but it’s fickle. Particularly with something with low switching costs.

Google has a low switching cost, and hardly anyone switches.

ChatGPT is quite similar to Google in this way.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by scarface_74 on Wednesday January 29, 2025 @11:34AM (#42867213)
Thought experiment: if tomorrow Apple changed the default search engine from Google to ChatGPT for iOS, how fast would Google’s dominance drop?

iOS has 70% market share in the US

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by JumpCrisscross on Wednesday January 29, 2025 @10:44AM (#42866334)
> Google has a low switching cost, and hardly anyone switches

Google has massive network effects on its ad business and a natural monopoly on its search index. Crawling the web is expensive. It’s why Kagi has to pay Google (versus being able to pay them once and then stop).

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by flavius29663 on Wednesday January 29, 2025 @10:37AM (#42866203)
just for the chatbot, it's trivial to switch, create a new account and start asking questions from deepseek instead. There is nothing holding the users in chatgpt.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @11:12AM (#42866801)
And the bigger risk is the big companies making deals - like Apple including ChatGPT access in iOS - canceling those to do it on-device or in-house.

1B MAUs doesn't look great if half of them come from one source that can easily change to a competitor.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by lm28469 on Wednesday January 29, 2025 @10:24AM (#42865993)
> They aren't going to switch unless something is substantially better.

Except one product is 100% free and the other is mostly locked behind paid subscriptions

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by scarface_74 on Wednesday January 29, 2025 @11:36AM (#42867255)
How long can DeepSeek stay free?

It’s already unable to keep up with demand, it will never be the default on mobile devices and businesses in the US will never trust it.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @11:39AM (#42867302)
That's not really the important question.

The important question is "will this and similar optimizations to come permit local LLM use, cutting OpenAI out of the equation entirely?"

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by scarface_74 on Wednesday January 29, 2025 @12:38PM (#42868288)
Businesses don’t even want to maintain servers locally. They definitely aren’t going to start managing servers beefy enough to run LLMs and try to run then with the reliability, availability, etc of cloud services.

This will make the cloud providers - especially AWS, GCP and to a lesser extent the also ran clouds more valuable. The other models hosted by AWS on Bedrock are already “good enough” for most business use cases.

And then consumers are definitely not going to be running LLMs locally on their computers to replicate ChatGPT (the product) anymore than they are going to get an FTP account, mount it locally with curlftpfs, and then using SVN or CVS on the mounted filesystem and then from Windows or Mac, accessed the FTP account through built-in software instead of using cloud storage like Dropbox. [1]

Whether someone comes up with a better product than ChatGPT and overcome the brand awareness is yet to be seen.

[1] Also the iPod had no wireless, less space than the Nomad and was lame.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @01:06PM (#42868731)
> And then consumers are definitely not going to be running LLMs locally on their computers to replicate ChatGPT...

Not personally. They'll let Apple handle it for them.

(This is already a thing. https://machinelearning.apple.com/research/introducing-apple...)

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by scarface_74 on Wednesday January 29, 2025 @01:14PM (#42868842)
There is a reason I kept emphasizing the ChatGPT product. The (paid) ChatGPT product is not just a text based LLM. It can interpret images, has a built in Python runtime to offload queries that LLMs aren’t good at like math, web search, image generation, and a couple of other integrations.

The local LLM on iPhones are literally 1% as powerful as the server based models like 4o.

That’s not even considering battery considerations

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @01:52PM (#42869387)
> The local LLM on iPhones are literally 1% as powerful as the server based models like 4o.

Currently, yes. That's why this is a compelling advance - it makes local LLMs much more feasible, especially if this is just the first of many breakthroughs.

A lot of the hype around OpenAI has been due to the fact that buying enough capacity to run these things wasn't all that feasible for competitors. Now, it is, potentially even at the local level.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by spinlock_ on Wednesday January 29, 2025 @10:34AM (#42866148)
I don't agree. You don't have moat if you are offering the same quality for a higher price.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by cogman10 on Wednesday January 29, 2025 @10:32AM (#42866121)
Free that runs locally on consumer hardware sounds substantially better.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by sandclock on Wednesday January 29, 2025 @10:27AM (#42866048)
That is exactly what a moat is. Keeping others out.

moat noun a deep, wide ditch surrounding a castle, fort, or town, typically filled with water and intended as a defense against attack.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by ceejayoz on Wednesday January 29, 2025 @10:31AM (#42866095)
Precisely. First place needs the moat.

Second place just needs a catapult and a diseased cow.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by meiraleal on Wednesday January 29, 2025 @11:04AM (#42866666)
oh well, I switched yesterday from a paid plan to a free one and I'm quite happy with the quality improvement.