Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by coder543 on Tuesday January 09, 2024 @10:04AM
(#38926970)
That is a very interesting discussion. Weird to me that the quantization code wasn’t required to be in the same PR. Ika is also already talking about a slightly higher 2.31bpw quantization, apparently.
[ Parent
| on HN ]
There are no comments on this comment yet.