Re:Apple's follow-up to M1 chip goes into mass production fo...
by JonathanFly on Tuesday April 27, 2021 @02:20PM
(#26959506)
>Maybe the commenter has a very interesting use for it, but why would you buy a 256 GB RAM machine (which isn't a lot of memory for this arena either) to develop the model, instead of using something smaller to work on it and leasing a big cluster for the minutes to hours of the day that you'll need to train it on the actual dataset?
A 128GB of a ram in a consumer PC is about $750 dollars (desktop anyway, laptop may be more?). That's less than a single high end consumer gaming GPU. Or a fraction of a Quadro GPU.
So to the extent that developers ever run things on their local hardware (CPU, GPU, whatever) 128GB of RAM is not much of a leap. Or 256GB for Threadripper. It's in the ballpark of having a high-end consumer GPU.
A 128GB of a ram in a consumer PC is about $750 dollars (desktop anyway, laptop may be more?). That's less than a single high end consumer gaming GPU. Or a fraction of a Quadro GPU.
So to the extent that developers ever run things on their local hardware (CPU, GPU, whatever) 128GB of RAM is not much of a leap. Or 256GB for Threadripper. It's in the ballpark of having a high-end consumer GPU.