News for hackers. Stuff that matters.
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by fldskfjdslkfj on Monday January 27, 2025 @11:23PM (#42848804)
The increase in efficiency is usually accompanied with the process of commoditization as stuff get cheaper to develop, which is very bad news for nvidia.

If you dont need the super high end chips than Nvidia loses it's biggest moat and ability to monopolize the tech, CUDA isn't enough.

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by aurareturn on Monday January 27, 2025 @11:55PM (#42848977)
Anthropic doesn’t train on Nvidia as far as I know. Google doesn’t either.

I don’t see how DeepSeek changes things.

By the way, DeepSeek trains on Nvidia.

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by haliskerbas on Tuesday January 28, 2025 @12:32AM (#42849175)
What do the others train on?
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by blovescoffee on Tuesday January 28, 2025 @12:44AM (#42849235)
Anthropic on Amazon trainium chips
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by saagarjha on Tuesday January 28, 2025 @04:52AM (#42850607)
And TPU, and normal GPUs. They like to have diversity in their stack.
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by aurareturn on Tuesday January 28, 2025 @12:43AM (#42849229)
Nvidia.
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by rsanek on Tuesday January 28, 2025 @12:44AM (#42849232)
"Anthropic currently uses systems containing chips from Nvidia as well as those with AWS’ Trainium and Inferentia chips to train its models." https://www.cio.com/article/3602879/anthropic-caught-up-in-a...
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by giantrobot on Tuesday January 28, 2025 @12:20AM (#42849102)
> Nvidia loses it's biggest moat and ability to monopolize the tech, CUDA isn't enough

CUDA is plenty for right now. AMD can't/won't get their act together with GPU software and drivers. Intel isn't in much better of a position than AMD and has a host of other problems. It's also unlikely the "let's just glue a thousand ARM cores together" hardware will work as planned and still needs the software layer.

CUDA won't be an Nvidia moat forever but it's a decent moat for the next five years. If a company wants to build GPU compute resources it will be hard to go wrong buying Nvidia kit. At least from a platform point of view.

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by fldskfjdslkfj on Tuesday January 28, 2025 @12:39AM (#42849213)
CUDA will still be a moat for the near future and nobody is saying that Nvidia will die, but the thing is that Nvidia margins will drop like crazy and so will it's valuation. It will go back down to being a "medium tech" company.

Basically training got way cheaper, and for inference you don't really need nvidia, so even if there's an increase for cheaper chips there's no way the volume makes up for the loss of margin.

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by Jlagreen on Tuesday January 28, 2025 @02:00AM (#42849618)
No, Nvidia's margins won't drop at all and the proof for this is Apple.

The units of AI accelerators will explode, the market will explode.

At the end of the day, Nvidia will have 20-30% of the unit share in AI HW and 70-80% of the profit share in the AI HW market. Just like Apple makes 3x the money compared to the rest of the smartphone market.

Jensen has considered Nvidia a premium vendor for 2 decades and track record of Nvidia's margins show this.

And while Nvidia remains a high premium AI infrastructure vendor, they will also add lots of great SW frameworks to make even more profit.

Omniverse has literally no competition. That digital world simulation combines all of Nvidia's expertise (AI HW, Graphics HW, Physics HW, Networking, SW) into one huge product. And it will be a revolution because it's the first time we will be able to finally digitalize the analog world. And Nvidia will earn tons of money because Omniverse itself is licensed, it needs OVX systems (visual part) and it needs DGX systems (AI part).

Don't worry, Nvidia's margins will be totally fine. I would even expect them to be higher in 10 years than they are today. Nobody believes that but that's Jensen's goal.

There is a reason why Nvidia has always been the company with the highest P/S ratio and anyone who understands why, will see the quality management immediately.

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by diamondfist25 on Tuesday January 28, 2025 @09:55AM (#42853008)
This. Well said.

People are blind to the llm gpt 3.5/r1 paradigm, and fail to see the other domains nvda is quietly setting up

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by flakeoil on Tuesday January 28, 2025 @03:51AM (#42850214)
Someone commented somewhere above that deepseek avoided using CUDA. So it means you can achieve very good results without Nvidia's CUDA.

"They skipped CUDA and instead used PTX which is a lower level instruction set"

Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by saagarjha on Tuesday January 28, 2025 @04:53AM (#42850613)
CUDA in this case is the ecosystem, not the programming language.
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by nly on Tuesday January 28, 2025 @03:26AM (#42850078)
Nobody ever got fired for buying Nvidia
Re:Nvidia, ASML Plunge as DeepSeek Triggers Tech Stock Selloff by cyberax on Tuesday January 28, 2025 @02:25AM (#42849771)
Intel seems to be getting its act together. Battlemage is a decent mid-range GPU, and Gaudi 3 seems to be a fairly decent AI attempt.