News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by bilekas on Tuesday June 13, 2023 @04:14AM (#36307162)
Well I think there are 2 types right ? Tensor cores (which afaik AMD dont have) which are better for matrix ops, and CUDO which are better for general parallel ops.

Maybe someone more clever than me can go into the specifics, I only understand the minimum of the low lvl GPU details.

Nice high lvl document

[0] https://www.acecloudhosting.com/blog/cuda-cores-vs-tensor-co...

There are no comments on this comment yet.