Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by gliptic on Saturday February 01, 2025 @07:46AM
(#42897918)
That's 1.2 t/s for the 14B Qwen finetune, not the real R1. Unless you go with the GPU with the extra cost, but hardly anyone but Jeff Geerling is going to run a dedicated GPU on a Pi.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by etra0 on Saturday February 01, 2025 @09:13AM
(#42898417)
it's using a Raspberry Pi with a.... USD$1k gpu, which kinda defeat the purpose of using the RPI in the first place imo.
or well, I guess you save a bit on power usage.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by firtoz on Saturday February 01, 2025 @10:29AM
(#42899068)
Oh, I was naive to think that the Pi was capable of some kind of magic (sweaty smile emoji goes here)
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by unethical_ban on Thursday February 06, 2025 @01:34PM
(#42965136)
I suppose it makes sense, for extremely GPU centric applications, that the pi be used essentially as a controller for the 3090.
> OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi
https://x.com/geerlingguy/status/1884994878477623485
I haven't tried it myself or haven't verified the creds, but seems exciting at least