DeepSeek-R1 with Dynamic 1.58-bit Quantization

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by fluoridation on Tuesday January 28, 2025 @04:40PM (#42858411)

What they meant is buying two whole separate computers.

[ Parent | on HN ]

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by riku_iki on Tuesday January 28, 2025 @04:51PM (#42858530)

I understand. It is still unclear if you can get 128GB vram for $3k.

[ Parent | on HN ]

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by fluoridation on Tuesday January 28, 2025 @05:01PM (#42858636)

Well, I mean, the press release is pretty unambiguous.

>Each Project DIGITS features 128GB of unified, coherent memory and up to 4TB of NVMe storage.

Even if $3k is only the starting price, it doesn't sound like spending more buys you more memory.

[ Parent | on HN ]

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by riku_iki on Tuesday January 28, 2025 @05:19PM (#42858848)

Ok, but it is not clear what kind of RAM is that, how many memory channels, etc. If the goal is to have just 128GB of some ram, then it could be achieved by paying few $100.

[ Parent | on HN ]

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by fluoridation on Tuesday January 28, 2025 @05:27PM (#42858934)

Fine, but at that point you're arguing about the concept of the product. It's billed as a computer for AI and you're saying that it might not be more suitable for AI than a regular PC.

[ Parent | on HN ]

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by riku_iki on Tuesday January 28, 2025 @05:30PM (#42858972)

it is possible that one could build better PC than digits for AI. We will see once they release digits.

[ Parent | on HN ]