News for hackers. Stuff that matters.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by thefounder on Tuesday January 28, 2025 @08:31AM (#42852066)
If I can write an email from my small and cheap phone why would I buy that big mainframe? The chips to do the job become cheap. The high end chips will become a niche again for research and mil. stuff.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by wongarsu on Tuesday January 28, 2025 @09:20AM (#42852573)
But if both the mainframe and personal computer are from IBM, is that scenario really bad for them?

If there was serious competition for cards to do GPU training that might spell trouble for Nvidia. But so far we only went from needing an absurdly huge cluster of Nvidia cards to a huge cluster of Nvidia cards, with Nvidia having a near-monopoly on cards used in deep-learning training all the way down to networks that fit on single cards.

Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by IshKebab on Tuesday January 28, 2025 @08:31AM (#42852072)
Because the big mainframe will write a much better email?
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by thefounder on Tuesday January 28, 2025 @08:33AM (#42852089)
It looks like that’s not the case anymore. That’s what this is all about.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by senko on Tuesday January 28, 2025 @08:47AM (#42852223)
It still is. The DeepSeek R1 is 670B parameters, requiring more than 300GB of video ram (or unified memory), even if using 4-bit quantized models.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by amazingamazing on Tuesday January 28, 2025 @08:55AM (#42852310)
How much video RAM was needed for similar performance a year ago?
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by senko on Tuesday January 28, 2025 @09:21AM (#42852584)
Roughly the same, as our collective goalposts have shifted, and are still shifting.

What was amazing output last year is today's slop.

NV is in no immediate danger; medium/long term, to anyone knowing what "75% gross margin" means it's no secret that there will be serious threats. You don't need DeepSeek for that particular realization.

Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by amazingamazing on Tuesday January 28, 2025 @09:29AM (#42852691)
Which open source model last January gave you similar results with the same amount of video ram?
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by talldayo on Tuesday January 28, 2025 @09:48PM (#42860931)
Nomic Falcon, Mixtral, YALM, Bloom, Grok-1 and Jamba, just to name a few of the foundation models.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by DannyBee on Tuesday January 28, 2025 @09:09AM (#42852454)
That only works until it's good enough that nobody cares about the difference.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by IshKebab on Tuesday January 28, 2025 @03:38PM (#42857648)
That will only happen when we have AGI and at that point the world has much bigger problems.
Re:DeepSeek could represent Nvidia CEO Jensen Huang's worst ... by DannyBee on Wednesday January 29, 2025 @07:20PM (#42873222)
This is definitely one view, but not sure I buy it at all.

History is littered with things that were made orders of magnitude better, people who claimed nobody would be happy until that happened, and then nobody writ large cared .

Tech in particular has a grand history of claiming we need to produce the technically best thing, but in practice, the market almost always chooses somewhere in the range of useful products, which is not the same at all - the technically best thing has rarely, if ever, become the market leader.