Re:Mixtral 8x22B
by apexalpha on Wednesday April 17, 2024 @11:18AM
(#40065927)
Is that normal ram of GPU ram?
[ Parent
| on HN ]
64GB is not GPU RAM, but system RAM. Consumer GPUs have 24GB at most, those with good value/price have way less. Current generation workstation GPUs are unaffordable; used can be found on ebay for a reasonable price, but they are quite slow. DDR5 RAM might be a better investment.