News for hackers. Stuff that matters.

A comment on DeepSeek-R1 with Dynamic 1.58-bit Quantization. Parent comment

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by JKCalhoun on Tuesday January 28, 2025 @09:06AM (#42852423)
Layman here — but I am hopeful for 1.58 bit plus custom silicon to be the Holy Grail. I suppose I am setting high expectations on Apple to integrate said in their next "A" chip.

Wishful thinking.

[ Parent | on HN ]
Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by danielhanchen on Tuesday January 28, 2025 @04:28PM (#42858285)
Ye a custom chip would be insane! 1.5 bit with a scaling factor seems to be actually usable for MoEs with shared experts!
[ Parent | on HN ]