Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by jsheard on Tuesday March 18, 2025 @04:42PM
(#43404823)
The memory is soldered on top of the package, here's an actual real life photo of the M1 package with two LPDDR packages sitting on it:
https://en.wikipedia.org/wiki/Apple_M1#/media/File:Mac_Mini_...
You could call that on-package, but it's not on-package in the same way that GPU HBM is, with that the main die and memory dies are packaged together on the same substrate. That's a much more difficult and expensive process, apparently packaging is the main bottleneck for H100/H200 production.
Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by nomel on Tuesday March 18, 2025 @06:14PM
(#43405815)
For that H100 image, how do they get the top surface of all the chips on the same plane? Do they solder them "upside down", so the chips are sitting on a reference plane, and the PCB is allowed to "float"? Or is the soldering controlled enough that they can just heat and be done?
Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by ein0p on Tuesday March 18, 2025 @05:44PM
(#43405538)
Nor is it a chiplet, in which case it would qualify as "in-SoC".
Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by TiredOfLife on Wednesday March 19, 2025 @06:29AM
(#43410203)
Wait till you learn that unified memory was in common use by pc's long before Apple "invented" it.
I remember Apple used to show slides depicting the M1 SoC as one unit containing a CPU, GPU, Neural Engine, cache, and DRAM all together. But slides shown at an Apple event definitely qualify for artistic license.