News for hackers. Stuff that matters.
Re:Apple unveils new Mac Studio, the most powerful Mac ever,... by _aavaa_ on Wednesday March 05, 2025 @11:33AM (#43268823)
This doesn’t sound correct.

You don’t know which expert you’ll need for each layer, so you either keep them all loaded in memory or stream them from disk

Re:Apple unveils new Mac Studio, the most powerful Mac ever,... by kgwgk on Wednesday March 05, 2025 @11:36AM (#43268888)
Note that 404 < 512
Re:Apple unveils new Mac Studio, the most powerful Mac ever,... by espadrine on Wednesday March 05, 2025 @11:39AM (#43268944)
In RAM, yes. But if you compute an activation, you need to load the weights from RAM to the GPU core.
Re:Apple unveils new Mac Studio, the most powerful Mac ever,... by _aavaa_ on Wednesday March 05, 2025 @11:44AM (#43269015)
Got you, yeah I misread you commend the first time around