Zen, CUDA, and Tensor Cores, Part I: The Silicon

Re:Zen, CUDA, and Tensor Cores, Part I: The Silicon by dundarious on Saturday September 07, 2024 @02:25PM (#41475482)

> It's almost certainly best just to compare TFLOPS

Depends on what you're comparing with what, and the context, of course.

Casey is doing education, so that people learn how best to program these devices. A mere comparison of TFLOPS of CPU vs GPU would be useless towards those ends. Similarly, just a bare comparison of TFLOPS between different GPUs even of the same generation would mask architectural differences in how to in practice achieve those theoretical TFLOPS upper bounds.

I think Casey believes most people don't know how to program well for these devices/architectures. In that context, I think it's appropriate to be almost dismissive of TFLOPS comparison talk.

[ Parent | on HN ]

Re:Zen, CUDA, and Tensor Cores, Part I: The Silicon by to11mtm on Sunday September 08, 2024 @01:51AM (#41478441)

> Depends on what you're comparing with what, and the context, of course.

Agreed

It's a classic question of 'what is an "embarrassingly parallel" problem' (e.x. physics calculations, image rendering, LLM image creation or textual content generation) or not.

[ Parent | on HN ]