Re:Mixtral 8x22B
by coder543 on Wednesday April 17, 2024 @11:16AM
(#40065887)
At what quantization? 4-bit is 80GB. Less than 4-bit is rarely good enough at this point.
[ Parent
| on HN ]
There are no comments on this comment yet.