News for hackers. Stuff that matters.

A comment on Complete hardware and software setup for running Deepseek-R1 locally. ($6000). Parent comment

Re:Complete hardware and software setup for running Deepseek... by btbuildem on Wednesday January 29, 2025 @12:04PM (#42867761)
Largest R1, as in the 671B? How do you accomplish that feat?
[ Parent | on HN ]
Re:Complete hardware and software setup for running Deepseek... by oynqr on Wednesday January 29, 2025 @04:55PM (#42871736)
Just do it? Llama.cpp doesn't load the entire thing into ram. It mmaps the file and the kernel takes care of the rest.
[ Parent | on HN ]