News for hackers. Stuff that matters.
Re:A Look at Cerebras Wafer-Scale Engine: Half Square Foot S... by rwmj on Sunday November 17, 2019 @05:18AM (#21557295)
It was considered quite seriously for CPUs back in the 1980s (the article touches on this). The problem is only perhaps 30% of the dies on the wafer will work. You end up with lots of dead silicon which needs routing around.

A current problem which it's unclear how Cerebras are handling is that CPUs and DRAM have different fabrication techniques which I guess can't be mixed on a single wafer, and you don't want your CPU to be too far away from its RAM. Edit: It seems they's using SRAM not DRAM, so that explains it but it must be low density and power hungry memory.

Re:A Look at Cerebras Wafer-Scale Engine: Half Square Foot S... by Symmetry on Sunday November 17, 2019 @07:55AM (#21557718)
SRAM tends to use less power per bit than DRAM does since it doesn't need to be refreshed, especially with 8T cells. Well, less power when not reading and per bit read. The difference in speeds is high enough, though, that SRAM running at max bandwidth will use more power than DRAM running at max bandwidth. And there are cases, possibly even the Cerebras chip, where the cost of getting the bit where you need it to be outweighs the cost of reading it and the greater density of DRAM might make it more efficient since you don't have to spend energy transporting it so far.
Re:A Look at Cerebras Wafer-Scale Engine: Half Square Foot S... by CuriousSkeptic on Sunday November 17, 2019 @07:27AM (#21557646)
But does that need to be a problem for ML-applications? I’m theory the training should be able to compensate for some broken hardware by simply moving weights around.
Re:A Look at Cerebras Wafer-Scale Engine: Half Square Foot S... by rbanffy on Sunday November 17, 2019 @10:23AM (#21558288)
But then you'll have a model that's specific to that chip and can't be applied on another.