Nvidia reveals Blackwell B200 GPU, the 'most powerful chip' for AI

Re:Nvidia reveals Blackwell B200 GPU, the 'most powerful chi... by jpeggtulsa on Monday March 18, 2024 @09:41PM (#39752178)

I'm pretty sure the WSE-3 chip from Cerebrus is way more powerful. It has 900,000 cores, and something like 27 petaflops of bandwidth between those cores, and shares all the memory with them, in one chip. They are developing an 8 exaflop cluster right now.

https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533...

[ Parent | on HN ]

Re:Nvidia reveals Blackwell B200 GPU, the 'most powerful chi... by _yo2u on Wednesday March 20, 2024 @02:25AM (#39763388)

you mean the chip that only has 44GB of memory on one chip and doesn't mention how fast chips can talk between each other?

[ Parent | on HN ]

Re:Nvidia reveals Blackwell B200 GPU, the 'most powerful chi... by jpeggtulsa on Sunday March 31, 2024 @07:02PM (#39889000)

Why cut up a a wafer of chips, package each with HBM, put the package on a board, connect to CPUs with a fabric, then tie them all back together with networking chips and cables? Their 3 new clusters are the top 3 biggest AI training platforms in the world. Comparing the WSE-3 against Nvidia's H100. "It's got 52 times more cores. It's got 800 times more memory on chip. It's got 7,000 times more memory bandwidth and more than 3,700 times more fabric bandwidth. But they don't sell the chips, they build the clusters and sell the compute power. Except for a couple they built in Dubai.

Plus, newer models are moving from Transformer to Mamba and don't need as much memory, because they save the important information, not everything it's been trained on.

[ Parent | on HN ]