Re:2023 was the year that GPUs stood still
by throw_nbvc1234 on Friday December 29, 2023 @12:04PM
(#38807282)
Mac Studio Pro's with up to 192GB ram are an alternative here too though still on the M2 Ultra chips if you don't need the portability. Not sure how relevant the generation bump is for running the models.
Might be a good hold-over for X years until the consumer hardware catches up and/or the model optimizations make the same hardware perform up to today's DC hardware.
Might be a good hold-over for X years until the consumer hardware catches up and/or the model optimizations make the same hardware perform up to today's DC hardware.