Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization
by danielhanchen on Tuesday January 28, 2025 @04:28PM
(#42858285)
Ye a custom chip would be insane! 1.5 bit with a scaling factor seems to be actually usable for MoEs with shared experts!
[ Parent
| on HN ]
There are no comments on this comment yet.