News for hackers. Stuff that matters.
Re:Mixtral 8x22B by samus on Wednesday April 17, 2024 @04:22PM (#40069671)
64GB is not GPU RAM, but system RAM. Consumer GPUs have 24GB at most, those with good value/price have way less. Current generation workstation GPUs are unaffordable; used can be found on ebay for a reasonable price, but they are quite slow. DDR5 RAM might be a better investment.

There are no comments on this comment yet.