News for hackers. Stuff that matters.

A comment on DeepSeek-R1 with Dynamic 1.58-bit Quantization. Parent comment

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by xbmcuser on Tuesday January 28, 2025 @08:16AM (#42851944)
I think just getting nvidia Project Digits might be the best option. A lot of people when it was announced were underwhelmed. But I think now it could be just the thing for people making their own ai home servers.

https://www.nvidia.com/en-us/project-digits/

[ Parent | on HN ]
Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by sourcecodeplz on Tuesday January 28, 2025 @12:14PM (#42854915)
Yep, I think the same. With 128GB fast memory one could run this.
[ Parent | on HN ]