News for hackers. Stuff that matters.

A comment on DeepSeek-R1 with Dynamic 1.58-bit Quantization. Parent comment

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by iamnotagenius on Tuesday January 28, 2025 @09:27AM (#42852645)
very strange as I get on old i5-12400+DDR4 2 tok/sec with 14B/q8 model.
[ Parent | on HN ]

There are no comments on this comment yet.