News for hackers. Stuff that matters.
Re:Micron Kicks Off Production of HBM3E Memory – AnandTech by a_wild_dandan on Wednesday February 28, 2024 @10:23AM (#39539108)
Yeah, my M2 MacBook has 96GB @400GB/s. For $4k or so, it feels like cheating. Does it beat 4x24GB NVIDIA cards? Absolutely not! It's slower and occasionally runs into CUDA-moat software issues. But the capability to daily drive Mixtral 8x7 locally, with great token speeds, is phenomenal.

There are no comments on this comment yet.