News for hackers. Stuff that matters.
Re:Apple Preps Next Mac Chips with Aim to Outclass Highest-E... by dragontamer on Monday December 07, 2020 @09:29AM (#25332403)
> Apple will likely have HBM on the 32 core packages

First of all, that's ludicrously expensive. You need an active interposer that's larger than the chip to do something like that. 4x HBM stacks means 4096 wires to run between your compute-device and the RAM, that's a lot of wires in a tiny area, and only possible with advanced packaging (expensive) methodologies.

Second: HBM2 based designs have poor memory-capacity: 8GB per stack means 4x HBM2 caps out at 32GBs under most reasonable configurations.

Going into 2021 with a ludicrously expensive 32GB machine seems a bit weak. I don't think anyone in the high-end market is targeting that level of memory capacity. Even if we're generous and HBM capacity doubles between now and then, I'm not sure if 64GBs is enough for workstation tasks.

HBM works for supercomputers, because when 32GB isn't enough, you just buy another node. A64FX, the current CPU-based supercomputer that uses HBM, only has 32GB/node. Then Fugaku bought 150,000 nodes.

Re:Apple Preps Next Mac Chips with Aim to Outclass Highest-E... by AnthonyMouse on Monday December 07, 2020 @03:27PM (#25336974)
They could use HBM as L4 cache. Though it still wouldn't be cheap.
Re:Apple Preps Next Mac Chips with Aim to Outclass Highest-E... by dragontamer on Monday December 07, 2020 @03:44PM (#25337238)
HBM's latency characteristics are about the same as any other DRAM however (including DDR4 or LPDDR4x).

So you have a high-bandwidth, but no better latency, L4 chip. And that's kind of hard to deal with and optimized against.

Xeon Phi had a DDR4 + HMC (where HMC was a early competitor to HBM), and getting good performance out of that was unusual. DDR4 ended up having slightly better latency, so the HMC cache would hurt some workloads.

Re:Apple Preps Next Mac Chips with Aim to Outclass Highest-E... by imtringued on Monday December 07, 2020 @10:53AM (#25333321)
I have a "low budget" PC with 32GB RAM and 8 cores. I don't know why anyone would want a workstation with less than 128GB RAM. Of course, the Apple world is extremely weird and you get massively overcharged for commodities like RAM.
Re:Apple Preps Next Mac Chips with Aim to Outclass Highest-E... by dragontamer on Monday December 07, 2020 @01:25PM (#25335244)
Well... my point isn't so much "Apple is stupid", as much as "Apple would be stupid to use HBM2... and I don't think Apple is stupid".

I think Apple would want to release a 64GB or 128GB Mac Pro... but only to upsell its customers to a 256GB or higher Mac Pro. The ability to configure more RAM into a system is key for marketing (even if this RAM is soldered onto the motherboard: like LPDDR4x, it wouldn't be too expensive to make different motherboards especially in a niche $10,000 computer like the Mac Pro).

But if Apple did go with HBM2 itself... well... then its physically unable to go above 32GB (today), or maybe ~64GB (if bigger HBM2 modules come out next year).

--------

Sticking with LPDDR4x just seems like the most obvious, and best, decision for Apple. So that's my expectation. But then again: making a 8-way decoder + fat-as-heck execution pipeline wasn't part of my expectation either. So maybe Apple will surprise us again.