Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM
by anaganisk on Tuesday June 06, 2023 @10:45AM
(#36213621)
*Apple Silicon, I'm no grammar Nazi, it made me chuckle.
Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM
by mrguyorama on Tuesday June 06, 2023 @04:47PM
(#36218899)
Can you imagine how much Apple would charge for branded boobs?
The memory bandwidth of the nVidia GPUs is also significantly higher than the M2 parts.
The Apple silicone parts are impressive for what they are, but they don’t have a huge efficiency advantage for GPU compute. The full-size GPUs with huge memory buses and a large number of cores are still significantly more powerful.
There’s also a matter of getting data into and out of the GPUs and across the network, which takes a lot more than 10Gbe
The Apple silicon is great for running development workloads locally, but it’s significantly slower than full size GPUs.
I’m kind of surprised at how quickly everyone forgot that Apple’s marketing material greatly exaggerates their GPU performance.