News for hackers. Stuff that matters.

A comment on The Short Case for Nvidia Stock. Parent comment

Re:The Short Case for Nvidia Stock by aurareturn on Monday January 27, 2025 @04:41PM (#42845968) 

  No - because this eliminates entirely or shifts the majority of work from GPU to CPU - and Nvidia does not sell CPUs.
I'm not even sure how to reply to this. GPUs are fundamentally much more efficient for AI inference than CPUs.
[ Parent | on HN ]
Re:The Short Case for Nvidia Stock by snailmailstare on Monday January 27, 2025 @05:50PM (#42846697)
I think SIMD is not so much better than SIMT for solved problems as a level in claiming a problem as solved.
[ Parent | on HN ]
Re:The Short Case for Nvidia Stock by aurareturn on Monday January 27, 2025 @11:09PM (#42848730)
What do you think GPUs are? Basically SIMD asics.
[ Parent | on HN ]
Re:The Short Case for Nvidia Stock by snailmailstare on Tuesday January 28, 2025 @02:02AM (#42849629)
That's also what AVX is but with a conservative number of threads.. If you really understand your problem I don't see why you would need 32 threads of much smaller data size or why you would want that far away from your CPU.

Whether your new coprocessor or instructions look more like a GPU or something else doesn't really matter if we are done squinting and calling it graphics like problems and/or claiming it needs a lot more than a middle class PC.

[ Parent | on HN ]