News for hackers. Stuff that matters.

A comment on DeepSeek-R1 with Dynamic 1.58-bit Quantization. Parent comment

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by immibis on Wednesday January 29, 2025 @07:23AM (#42864083)
I spent about $3000 on my machine, have the cheapest Threadripper CPU and 256GB of RAM, so no, 600GB won't fit in RAM on a $2K machine.

But everyone is using the distilled models which are much smaller.

[ Parent | on HN ]

There are no comments on this comment yet.