News for hackers. Stuff that matters.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by ynniv on Saturday February 01, 2025 @09:33AM (#42898581)
Umm, two 3090's? Additional cards scale as long as you have enough PCIe channels.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by gliptic on Saturday February 01, 2025 @09:51AM (#42898721)
I arbitrarily chose $1k as the "cheap" cut-off. Two 3090 is definitely the most bang for the buck if you can fit them.