Complete hardware and software setup for running Deepseek-R1 locally. ($6000)

Re:Complete hardware and software setup for running Deepseek... by monobot12 on Wednesday January 29, 2025 @11:41AM (#42867346)

If you don't mind a speed of 1 token per second, you can run the largest R1 model on a 2021 iMac, as I just did.

[ Parent | on HN ]

Re:Complete hardware and software setup for running Deepseek... by btbuildem on Wednesday January 29, 2025 @12:04PM (#42867761)

Largest R1, as in the 671B? How do you accomplish that feat?

[ Parent | on HN ]

Re:Complete hardware and software setup for running Deepseek... by oynqr on Wednesday January 29, 2025 @04:55PM (#42871736)

Just do it? Llama.cpp doesn't load the entire thing into ram. It mmaps the file and the kernel takes care of the rest.

[ Parent | on HN ]

Re:Complete hardware and software setup for running Deepseek... by jeffbee on Wednesday January 29, 2025 @11:56AM (#42867629)

Are we speaking of a 2020-edition Intel 27" iMac or a 2021 M1?

[ Parent | on HN ]