News for hackers. Stuff that matters.
Re:Demystifying NPUs: Questions and Answers by TheDudeMan on Tuesday June 11, 2024 @06:31PM (#40652401)
High-end Nvidia GPUs are not optimized for 3D rendering; they are optimized for machine learning and inference.
Re:Demystifying NPUs: Questions and Answers by taneq on Tuesday June 11, 2024 @07:28PM (#40652855)
They're not really GPUs then, are they? Even if they're capable of generating a video output.
Re:Demystifying NPUs: Questions and Answers by Dalewyn on Tuesday June 11, 2024 @08:48PM (#40653321)
They are GPUs, but standing for General Processing Unit. "GPU" the acronym has persisted from sheer force of tradition and habit, but what it means has changed drastically over the past several years between cryptocurrency and now "AI".

I wonder if NPU will supercede GPU as in General Processing Unit now that it has finally entered the wider lexicon, relegating GPU back to Graphics Processing Unit or video cards.

And no, GPGPU (General Purpose Graphics Processing Unit) is a bloody stupid term to be bluntly honest.

Re:Demystifying NPUs: Questions and Answers by lxgr on Tuesday June 11, 2024 @11:49PM (#40654275)
Acronyms don’t just change their meaning through a lack of tradition and habit. Etymology doesn’t have an expiration date.

Very rarely, an acronym is “retconned” into a more appropriate expansion or simply starts being considered a regular word not standing for anything.

I’d strongly challenge your assertion that this has happened for “GPU”.

Re:Demystifying NPUs: Questions and Answers by taneq on Tuesday June 11, 2024 @09:47PM (#40653666)
That might be how you use the term but GPU is still almost universally used to mean graphics processing unit. If it want to use a ubiquitous acronym to mean something different, you need to define it first.
Re:Demystifying NPUs: Questions and Answers by Dalewyn on Tuesday June 11, 2024 @09:55PM (#40653717)
>GPU is still almost universally used to mean graphics processing unit.

No, GPU is almost universally used to mean GPU. There is nothing graphical about cryptocurrency, "AI" (sans image generation), protein crunching, and whatever else they are being used for that aren't graphical.

I question how many people are even aware the G is supposed to stand for Graphics anymore. The nomenclature is outdated and doesn't reflect reality anymore.

Re:Demystifying NPUs: Questions and Answers by smcin on Wednesday June 12, 2024 @06:33PM (#40663927)
> I question how many people are even aware the G is supposed to stand for Graphics anymore.

Most people aren't aware, because the industry never called attention to the morphng definition of GPU.

At that, CPUs aren't Central (for large-scale array-oriented computing workloads) anymore either. (They still are for enterprise or web workloads. Or, they're "Central" in terms of coordinating GPUs and moving data around. But no longer "Central" in terms of "does most of the computing".)

Re:Demystifying NPUs: Questions and Answers by _flux on Wednesday June 12, 2024 @11:03AM (#40658949)
The current GPUs aren't really that generally applicable though, as they are most useful when you need to do a bunch of number crunching on a lot of data of the same structure—which is why we still run compilers on CPUs.

If you are offended by the term GPGPU, maybe we could use the name Compute Processing Unit :-).

Re:Demystifying NPUs: Questions and Answers by Dalewyn on Wednesday June 12, 2024 @08:08PM (#40664540)
>If you are offended by the term GPGPU, maybe we could use the name Compute Processing Unit :-)

I can certainly drink to that.

Re:Demystifying NPUs: Questions and Answers by xcv123 on Tuesday June 11, 2024 @09:25PM (#40653541)
You're right that GPU is a misnomer these days. The top-end chips are for HPC and scientific computing in general. Good for training, inference, and non-AI applications such as molecular dynamics simulations. They can accelerate FFT and linear solvers. Their applications are broader than AI/ML. Useful for physics simulations.
Re:Demystifying NPUs: Questions and Answers by aragilar on Wednesday June 12, 2024 @06:07AM (#40656389)
Depends on the chips, I've been hearing from people that NVidia ones (due to various changes in design which preference low-precision over high precision) are becoming more and more useless for traditional HPC, and so there's a move on to switch to AMD (noting that the software side of AMD is still not good). https://news.ycombinator.com/item?id=40655965 suggests Apple's hardware would have similar issues.