News for hackers. Stuff that matters.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by firtoz on Saturday February 01, 2025 @07:37AM (#42897875)
Would it be something like this?

> OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi

https://x.com/geerlingguy/status/1884994878477623485

I haven't tried it myself or haven't verified the creds, but seems exciting at least

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by gliptic on Saturday February 01, 2025 @07:46AM (#42897918)
That's 1.2 t/s for the 14B Qwen finetune, not the real R1. Unless you go with the GPU with the extra cost, but hardly anyone but Jeff Geerling is going to run a dedicated GPU on a Pi.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by etra0 on Saturday February 01, 2025 @09:13AM (#42898417)
it's using a Raspberry Pi with a.... USD$1k gpu, which kinda defeat the purpose of using the RPI in the first place imo.

or well, I guess you save a bit on power usage.

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by firtoz on Saturday February 01, 2025 @10:29AM (#42899068)
Oh, I was naive to think that the Pi was capable of some kind of magic (sweaty smile emoji goes here)
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by unethical_ban on Thursday February 06, 2025 @01:34PM (#42965136)
I suppose it makes sense, for extremely GPU centric applications, that the pi be used essentially as a controller for the 3090.