News for hackers. Stuff that matters.
Re:Nvidia pursues $30B custom chip opportunity with new unit by godelski on Sunday February 11, 2024 @02:35AM (#39333246)
I'd be hard pressed to buy a comparison to a 4090. But yeah, things would be better if they didn't "dump everything into VRAM"
Re:Nvidia pursues $30B custom chip opportunity with new unit by LoganDark on Sunday February 11, 2024 @07:31AM (#39334585)
They're comparing incredibly hand-optimized MLX inference on the Mac to off-the-shelf stuff on the 4090. So I'd believe it just because the 4090's being given an artificial disadvantage, and the Mac is being given meticulous hand-optimization by the foremost experts on the very platform it runs on.

In other words, the Mac is being given a huge optimization advantage compared to the 4090. And it's roughly competitive.

Even that is no mean feat.

Source: https://appleinsider.com/articles/23/12/13/apple-silicon-m3-...