How to run Deepseek-R1 locally for only $6000

Re:How to run Deepseek-R1 locally for only $6000 by test6554 on Wednesday January 29, 2025 @12:56AM (#42862006)

So a single RTX 4080 ain't gonna cut it. :-(

[ Parent | on HN ]

Re:How to run Deepseek-R1 locally for only $6000 by lodovic on Wednesday January 29, 2025 @01:44AM (#42862250)

This is about the price of 3 5090's, but it can run the full 670B model with Q8 quantitization, albeit at a few tokens per second. Doing this on GPUs would require 24 5090's (if nvlink still works, but I don't think so) or 10 H100's.

[ Parent | on HN ]